US20170186206A1 - Representation of overlapping visual entities - Google Patents
Representation of overlapping visual entities Download PDFInfo
- Publication number
- US20170186206A1 US20170186206A1 US15/459,976 US201715459976A US2017186206A1 US 20170186206 A1 US20170186206 A1 US 20170186206A1 US 201715459976 A US201715459976 A US 201715459976A US 2017186206 A1 US2017186206 A1 US 2017186206A1
- Authority
- US
- United States
- Prior art keywords
- visual
- entities
- entity
- foundation
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 230000000007 visual effect Effects 0.000 title claims abstract description 237
- 238000012800 visualization Methods 0.000 claims abstract description 39
- 238000000034 method Methods 0.000 claims description 72
- 230000003993 interaction Effects 0.000 claims description 32
- 230000004044 response Effects 0.000 claims description 4
- 238000009877 rendering Methods 0.000 claims 2
- 238000010586 diagram Methods 0.000 description 18
- 230000008569 process Effects 0.000 description 9
- 230000008859 change Effects 0.000 description 8
- 238000013507 mapping Methods 0.000 description 8
- 238000007792 addition Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 238000013079 data visualisation Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25B—TOOLS OR BENCH DEVICES NOT OTHERWISE PROVIDED FOR, FOR FASTENING, CONNECTING, DISENGAGING OR HOLDING
- B25B11/00—Work holders not covered by any preceding group in the subclass, e.g. magnetic work holders, vacuum work holders
- B25B11/002—Magnetic work holders
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/40—Information retrieval; Database structures therefor; File system structures therefor of multimedia data, e.g. slideshows comprising image and additional audio data
- G06F16/44—Browsing; Visualisation therefor
- G06F16/444—Spatial browsing, e.g. 2D maps, 3D or virtual spaces
-
- G06F17/241—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/169—Annotation, e.g. comment data or footnotes
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B29/00—Maps; Plans; Charts; Diagrams, e.g. route diagram
- G09B29/003—Maps
- G09B29/006—Representation of non-cartographic information on maps, e.g. population distribution, wind direction, radiation levels, air and sea routes
- G09B29/007—Representation of non-cartographic information on maps, e.g. population distribution, wind direction, radiation levels, air and sea routes using computer methods
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/14—Display of multiple viewports
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/37—Details of the operation on graphic patterns
- G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B5/00—Recording by magnetisation or demagnetisation of a record carrier; Reproducing by magnetic means; Record carriers therefor
- G11B5/48—Disposition or mounting of heads or head supports relative to record carriers ; arrangements of heads, e.g. for scanning the record carrier to increase the relative speed
- G11B5/54—Disposition or mounting of heads or head supports relative to record carriers ; arrangements of heads, e.g. for scanning the record carrier to increase the relative speed with provision for moving the head into or out of its operative position or across tracks
- G11B5/55—Track change, selection or acquisition by displacement of the head
- G11B5/5521—Track change, selection or acquisition by displacement of the head across disk tracks
- G11B5/5569—Track change, selection or acquisition by displacement of the head across disk tracks details of specially adapted mobile parts, e.g. electromechanical control devices
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04806—Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
- G06T2219/004—Annotating, labelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/10—Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/12—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
- G09G2340/125—Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels wherein one of the images is motion video
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/14—Solving problems related to the presentation of information to be displayed
- G09G2340/145—Solving problems related to the presentation of information to be displayed related to small screens
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2354/00—Aspects of interface with display user
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
- Y10T—TECHNICAL SUBJECTS COVERED BY FORMER US CLASSIFICATION
- Y10T29/00—Metal working
- Y10T29/49—Method of mechanical manufacture
- Y10T29/49998—Work holding
Definitions
- mapping application can have access to a multitude of locations (e.g., restaurants, banks, hotels, parks, and so on) that can be displayed as part of a map view.
- locations e.g., restaurants, banks, hotels, parks, and so on
- the sheer number of locations available for display can cause a particular map view to become cluttered and reduce the usability of the map view.
- the combined visual entity can include a primary visualization that represents one of the overlapping visual entities and annotations that represent others of the overlapping visual entities.
- a map view can include multiple geographical entities that overlap.
- a primary visualization can be rendered that represents one of the multiple geographical entities.
- the primary visualization can be visually annotated (e.g., with symbols, letters, or other visual indicators) to indicate others of the multiple geographical entities.
- a zoom operation can cause visual entities to be added and/or removed from the combined visual entity.
- overlapping visual entities are grouped into a cluster that can be opened to reveal individual visual entities that form the cluster.
- a cluster is represented on a map by a visual representation known as a foundation.
- a user can interact with the foundation to cause the cluster to be opened to reveal a flyout that includes individual visual entities that form the cluster.
- the visual entities can represent geographical locations in a map view.
- a user can also interact with an individual visual entity of the flyout to acquire more information about the visual entity.
- FIG. 1 illustrates an operating environment in which various principles described herein can be employed in accordance with one or more embodiments.
- FIG. 2 illustrates how a cluster of visual entities can be visualized in accordance with one or more embodiments.
- FIG. 3 illustrates how a foundation can be expanded to reveal a flyout in accordance with one or more embodiments.
- FIG. 4 illustrates how a foundation can be used to illustrate a cluster in a street view scenario in accordance with one or more embodiments.
- FIG. 5 illustrates how interaction with a flyout can cause information about a flyout entity to be presented in accordance with one or more embodiments.
- FIG. 6 illustrates how interaction with a flyout can cause information about a flyout entity to be presented in accordance with one or more embodiments.
- FIG. 7 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 8 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 9 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 10 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 11 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 12 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 13 illustrates how overlapping data sets can be visualized in accordance with one or more embodiments.
- FIG. 14 illustrates an example combined visual entity in accordance with one or more embodiments.
- FIG. 15 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 16 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 17 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- FIG. 18 illustrates an example system that can be used to implement one or more embodiments.
- the combined visual entity can include a primary visualization that represents one of the overlapping visual entities and annotations that represent others of the overlapping visual entities.
- a map view can include multiple geographical entities that overlap.
- a primary visualization can be rendered that represents one of the multiple geographical entities.
- the primary visualization can be visually annotated (e.g., with symbols, letters, or other visual indicators) to indicate others of the multiple geographical entities.
- a zoom operation can cause visual entities to be added and/or removed from the combined visual entity.
- overlapping visual entities are grouped into a cluster that can be opened to reveal the individual visual entities that form the cluster.
- a visual entity can represent a data entity, such as a geographical location, a business, a residence, an instance of content, a data file, and so on.
- overlapping visual entities can represent geographical locations on a map that are combined to form a cluster, and the cluster can be opened to reveal the individual geographical locations that form the cluster.
- the cluster can be opened independent of a zoom operation.
- a cluster is represented on a map by a visual representation known as a foundation.
- a user can interact with the foundation to cause the cluster to be opened to reveal a flyout that includes individual visual entities (e.g., geographic locations) that form the cluster.
- a user can also interact with an individual entity of the flyout to acquire more information about the entity.
- user interaction can include hovering operations, proximity operations (e.g., user interaction within a certain proximity of a foundation or other entity), clicking operations, keyboard selection operations, touch operations, and the like.
- Example Cluster Visualizations describes how clusters of entities can be visualized in accordance with one or more embodiments.
- Constructing and Interacting with Clusters describes how a cluster can be formed and how a visualization of a cluster can be interacted with in accordance with one or more embodiments.
- a section entitled “Representation of Overlapping Visual Entities” describes how a combined visualization can be used to visually indicate overlapping data sets in accordance with one or more embodiments.
- Example System describes an example system that can be utilized to implement one or more embodiments.
- FIG. 1 illustrates an operating environment in accordance with one or more embodiments, generally at 100 .
- Environment 100 includes a computing device 102 having one or more processors 104 , one or more computer-readable storage media 106 and one or more applications 108 that reside on the computer-readable storage media and which are executable by the processor(s).
- the computer-readable storage media can include, by way of example and not limitation, all forms of volatile and non-volatile memory and/or storage media that are typically associated with a computing device. Such media can include ROM, RAM, flash memory, hard disk, removable media and the like.
- FIG. 18 One specific example of a computing device is shown and described below in FIG. 18 .
- computing device 102 includes a software application in the form of a web browser 110 . Any suitable web browser can be used examples of which are available from the assignee of this document and others.
- computer-readable storage media 106 can include a layer manager 112 and a cluster manager 114 that are configured to operate as described below. Each of layer manager 112 and cluster manager 114 can be implemented as a standalone component that can be utilized by applications 108 and/or browser 110 . Alternately or additionally, layer manager 112 and/or cluster manager 114 can be implemented as part of applications 108 and/or browser 110 . Examples of Applications 108 can include a mapping platform (e.g., utilizing 2D and/or 3D maps), an operating system, a file explorer, and so on.
- mapping platform e.g., utilizing 2D and/or 3D maps
- layer manager 112 handles layers of data for the applications 108 .
- a mapping application can include multiple layers of map data that can be used to populate a map view.
- Each of the multiple layers can include different types of entities and map data.
- a first layer may include restaurants
- a second layer may include educational institutions
- a third layer may include locations defined by an end-user, and so on.
- multiple layers can be overlaid, one on another, to create a particular map view.
- layer manager 112 is configured to handle a variety of different tasks, such as tracking a location for a visual entity, maintaining different visual forms for a visual entity, managing the z-order (e.g., layer order) of different layers and/or visual entities, and so on.
- cluster manager 114 works in a mapping context to enable various visual entities to be grouped into a cluster.
- a visual entity can represent a data entity, such as a geographical location, an instance of media content, a data file, and the like.
- the cluster manager can group visual entities into a cluster by determining overlap between visual entities in a particular display region. When a particular group of visual entities overlap by at least a threshold amount, the group of visual entities can be formed into a cluster. Overlap can be measured using a variety of different metrics, such as screen pixels, world-coordinates (e.g., GPS coordinates, latitude, longitude, and so on), street addresses, and so on. Example ways of determining overlap are discussed below.
- layer manager 112 and cluster manager 114 are configured to interact and communicate to group visual entities into clusters and to place visual entities and clusters in a particular display view.
- Layer manager 112 can provide cluster manager 114 with different types of information that can be used by the cluster manager to create and manage clusters. Examples of this information include:
- Entity list This is a list of visual entities and/or data entities in a particular system. For example, in a map scenario, this can include a list of geographic entities and visual representations of the geographic entities that are available to populate a map.
- Visible entities This is a list of the visual entities that are in a current view. For example, this may include geographical entities that are represented in a current map view.
- Visual entities This includes a location and dimension for each visual entity.
- this information may include a location (e.g., in screen coordinates) and a dimension (e.g., in pixels relative to the screen coordinates) of a visual entity.
- Z-order This includes a z-order for visual entities, clusters, and/or layers in a particular system.
- a particular visual entity can have a z-order that indicates that the entity is to be displayed above (e.g., occlude) other visual entities in a display view.
- Entity status This indicates changes in entity status for a particular render pass. For example, this information can indicate that an entity was added, removed, or changed z-order for a particular render pass.
- the term “render pass” refers to a re-draw of entities in a display view. A render pass can occur responsive to changes in a display view, such as a zoom operation, the addition or removal of entities, a change in cluster membership, and so on.
- Layer Membership This indicates which entities belong to which layer and an order for each of the layers in a layer set.
- cluster manager 114 can receive some or all of this information from layer manager 112 , process the information, and generate further information that can be passed back to the layer manager to populate a particular display view. Examples of this further information can include:
- Updated entity list This can include an updated list of entities (including cluster entities) and a list of entities that were removed from existing clusters.
- Entity layers This can include a list of layers that include entities included in clusters.
- Cluster membership This can include an indication of a cluster membership for an entity.
- Entity change This can include an indication of visual entities and/or clusters that should be added or removed from a display view.
- Cluster z-order This can include a z-order for entities in a particular cluster.
- Visual elements This can include a visual representation to be used to represent a cluster.
- each of multiple clusters can be associated with a unique visual representation.
- environment 100 includes a network 116 , such as the Internet, and one or more web sites 118 from and to which content can be received and sent.
- content can include map content that can be operated upon by layer manager 112 and/or cluster manager 114 , as described above and below. It is to be appreciated and understood that the layer manager and/or the cluster manager can reside on a server or network-accessible computer, other than computing device 102 .
- Computing device 102 can be embodied as any suitable computing device such as, by way of example and not limitation, a desktop computer, a portable computer, a handheld computer such as a personal digital assistant (PDA), cell phone, a mobile device, and the like.
- a desktop computer such as a desktop computer, a portable computer, a handheld computer such as a personal digital assistant (PDA), cell phone, a mobile device, and the like.
- PDA personal digital assistant
- environment 100 can include a plug-in framework (e.g., embodied on computing device 102 ) that enables developers, programmers, and other parties to utilize the techniques and processes discussed herein in separate implementations.
- a plug-in framework e.g., embodied on computing device 102
- developers, programmers, and other parties to utilize the techniques and processes discussed herein in separate implementations.
- FIG. 2 illustrates one example way in which multiple overlapping visual entities can be visualized as a cluster in a mapping context in accordance with one or more embodiments.
- a map view 202 displays a group of visual entities and includes a map region 204 .
- a map view 206 illustrates a map view that is displayed after a zoom-out operation occurs on map view 202 .
- the map view 206 includes map region 204 as well as additional visual entities. As illustrated in map view 206 , the increase in the map scale resulting from the zoom-out operation has caused visual entities within map region 204 to be grouped together such that some visual entities visually occlude other visual entities.
- FIG. 2 Further illustrated in FIG. 2 is a map view 208 that includes map region 204 and a foundation 210 .
- foundation 210 is a visual representation of a cluster that is created using visual entities from map region 204 .
- the overlapping group of visual entities displayed in map region 204 of map view 206 can be replaced with foundation 210 .
- Foundation 210 can represent a unified visual representation that a user can interact with to view visual entities included in the cluster and to find out more information about the visual entities.
- a visualization for a foundation can be defined for an application by an application developer and/or the visualization can be selected by an end-user.
- a visualization for a foundation is customizable to provide a unique visual appearance for a cluster.
- FIG. 3 illustrates one example way in which user interaction with a foundation can reveal visual entities that form a cluster in accordance with one or more embodiments.
- a map view 300 includes the foundation 210 discussed above with reference to FIG. 2 .
- a user has placed a cursor over the foundation 210 (e.g., by manipulating the cursor with a mouse), which has caused a flyout 304 to replace foundation 210 .
- Flyout 304 includes visual entities that form the cluster represented by foundation 210 .
- the visual entities are tied together as part of flyout 304 by graphic lines, indicating that the visual entities represent clustered entities and that the visual entities may not be displayed at a correct location for an underlying data entity.
- a visualization for a flyout can be defined for an application by an application developer and/or the visualization can be selected by an end-user.
- a flyout visualization is customizable to provide a unique visual appearance for visual entities in a cluster.
- foundation 210 and flyout 304 have a dynamic relationship that responds to user interaction with the foundation and/or the flyout.
- FIG. 4 illustrates one example way of using a foundation to represent a cluster in a street view paradigm in accordance with one or more embodiments.
- a street view 400 is a two-dimensional approximation of a three-dimensional view.
- street view 400 can approximate the view of a person who is traveling (e.g., walking or driving) along a street.
- some visual entities can occlude other visual entities.
- a foundation/flyout combination represented by foundation 402
- the design of a foundation and/or flyout can be configured to convey meaning in a particular context.
- a visualization for a foundation can include a building at a particular location and an associated flyout can include a map of different locations within the building.
- FIG. 5 illustrates one example way of interacting with a foundation to view visual entities in a cluster in accordance with one or more embodiments.
- a foundation 502 is illustrated.
- a foundation is a visual representation of clustered entities.
- user interaction with foundation 502 causes an underlying cluster to open and reveal a flyout 506 .
- user interaction with a visual entity 510 reveals information about visual entity 510 . In this particular example, the information is included in a popup window 512 .
- the popup window 512 causes the popup window to expand and reveal further information about the visual entity 510 .
- the further information includes selectable links that can be selected to navigate to functionality associated with the represented entity.
- FIG. 6 illustrates an alternative embodiment of a foundation/flyout combination in accordance with one or more embodiments.
- a foundation 602 is displayed that represents a cluster of visual entities.
- foundation 602 is annotated to indicate aspects of one or more of the visual entities of the underlying cluster.
- foundation 602 includes an “R” which indicates that one of the entities is a restaurant, a “C” which indicates that one of the entities is a coffee shop, and a “P” which indicates that one of the entities is associated with parking.
- user interaction with foundation 602 causes a popup window 606 to be displayed.
- a user interacts with the popup window 606 .
- user interaction with popup window 606 can include causing a cursor to hover over the popup window.
- the user interaction with popup window 606 causes the popup window to expand to reveal more information about visual entities included in the cluster represented by foundation 602 .
- the information includes a scrollable list of business entities that are part of the cluster.
- user interaction with one of the listed business entities causes popup window 606 to be populated with more information about the business entity.
- FIG. 7 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- the method discussed with reference to FIG. 7 in addition to any other of the methods discussed herein, can be implemented in connection with any suitable hardware, software, firmware or combination thereof.
- aspects of the methods discussed herein can be implemented by software modules, such as layer manager 112 and/or cluster manager 114 discussed in FIG. 1 . It is to be appreciated and understood that the methods discussed herein can be performed by a suitably-configured server, a network-accessible computing device, and/or a client computing device.
- Step 700 ascertains visual entities that are available in the system to be displayed.
- the visual entities can represent geographical locations that can occur in a particular map view.
- the visual entities can be stored at a local resource (e.g., computing device 102 ) and/or available from a remote resource.
- Step 702 determines a location for each visual entity in the system. In some embodiments, the location may be in terms of screen location (e.g., screen coordinates), real-world location (e.g., GPS coordinates, street address, latitude/longitude coordinates, and so on), computer directory location, and so on.
- Step 704 determines that a group of visual entities forms a cluster. Example ways of performing step 704 are discussed in more detail below.
- Step 706 renders a visual representation of the cluster. Example visual representations of a cluster are discussed above (e.g., a foundation) and below.
- a data entity can opt in or opt out of the clustering process. For example, when a particular data entity opts into the clustering process, a visual entity that represents the data entity will be considered when determining clusters. When a particular data entity opts out of the clustering process, however, a visual entity that represents the data entity will be omitted when determining clusters.
- the tourist attraction When the tourist attraction registers with a particular data layer (e.g., to be included in a map), the tourist attraction provides an indication that it is opting out of the clustering process. When the clustering process is performed for a map region where the tourist attraction occurs, the tourist attraction is not considered in forming a cluster. Thus, according to some embodiments, the clustering process would normally group a visual representation of the tourist attraction with other visual entities to form a cluster. Since the tourist attraction has opted out of the clustering process, however, a visual representation of tourist attraction is not included as part of a cluster, e.g., as part of a foundation. Thus, in some embodiments, a visual representation of the tourist attraction can be rendered separately from an adjacent foundation.
- FIG. 8 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- the method can be implemented to form a cluster that includes multiple visual entities.
- Step 800 sorts visual entities to determine x-coordinate overlap.
- a configurable x-coordinate threshold overlap can be specified that can be used to determine if two or more visual entities overlap such that they can be members of a cluster.
- a threshold overlap of N pixels can be specified.
- the acts of sorting discussed above and below can be accomplished in linear time using a linear sort algorithm (e.g., Radix sort).
- Step 802 determines x-pass groups based on collections of visual entities that exceed an x-coordinate overlap threshold. As illustrated in the projection from step 802 , the entities within box 804 and box 806 exceed an x-pass overlap threshold and thus are grouped as x-pass groups. Step 808 sorts the x-pass groups by y-coordinate overlap.
- Step 810 forms clusters using x-pass groups that include collections of visual entities that exceed a y-coordinate overlap threshold.
- a configurable threshold y-coordinate overlap can be specified or the threshold x-coordinate overlap discussed above can be utilized in sorting the x-pass groups by y-coordinate overlap.
- a cluster 812 and a cluster 814 have been formed as a result of step 810 .
- a maximum number of visual entities permitted in a cluster can be specified. For example, a maximum of 5 visual entities per cluster can be specified. If a cluster exceeds the maximum number of visual entities, the cluster can be broken up into separate clusters and/or visual entities can be removed from the cluster until it reaches the maximum size.
- a final step can be performed whereby clusters that exceed a maximum number of visual entities can be broken up into multiple clusters (e.g., two or more smaller clusters) and/or visual entities can be removed from a cluster that exceeds a maximum number of visual entities.
- visual entities that are removed from a cluster can be displayed separately from a foundation.
- FIG. 9 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- the method can be implemented to form a cluster that includes multiple geographic entities. Examples of geographic entities include street addresses, businesses, residential locations, and so on.
- Step 900 determines geographic coordinates for each geographic entity of a collection of geographic entities. Examples of geographic coordinates include latitude coordinates, longitude coordinates, GPS coordinates, and so on.
- Step 902 forms a cluster that includes geographic entities with matching geographic coordinates.
- One example way of performing step 902 is to compute a hash value using geographical coordinates for each geographic entity. For example, a one-pass linear bucketing of the geographical coordinates can be performed. Geographic entities with identical and/or similar hash values are then grouped together to form a cluster.
- Step 904 renders a visual representation of the cluster.
- this method of forming clusters can be useful in a street view scenario (see, e.g., the discussion above with respect to FIG. 4 ) to form clusters using geographical entities that occur at the same or similar location (e.g., a particular street address).
- clusters can additionally or alternatively form clusters utilizing entities that are like or similar in nature.
- some clustering techniques can form clusters using similar entities, such as a restaurant cluster, a tourist attraction cluster, a coffee shop cluster, and so on.
- a cluster-forming technique can consider the proximity and/or overlap of entities and can also consider the nature of each of the entities. For example, if two entities are of disparate types (e.g., one is a restaurant and the other is a sporting goods store), the two entities may not be included in the same cluster.
- FIG. 10 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- the method can be implemented to cluster and/or de-cluster entities in response to a zoom operation.
- Step 1000 receives an indication of an initiation of a zoom level change.
- step 1000 can be performed responsive to user interaction with a zoom (e.g., zoom-in or zoom-out) function.
- Step 1002 ungroups visual entities that form a first cluster.
- the first cluster can be ungrouped responsive to receiving the indication of the zoom level change.
- Step 1004 receives an indication of completion of the zoom level change.
- the zoom level change can include a zoom-in and/or a zoom-out operation.
- Step 1006 determines whether or not the visual entities form a cluster. Example ways of determining that visual entities form a cluster are discussed above and below. If the visual entities form a cluster (“Yes”), step 1008 renders a visual representation of a second cluster. In some embodiments, the second cluster may include the same visual entities as the first cluster, fewer visual entities than the first cluster, or more visual entities than the first cluster. If the visual entities do not form a cluster (“No”), step 1010 renders separate visual entities.
- FIG. 11 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- Step 1100 renders a foundation.
- the foundation includes a visual representation of a cluster.
- Step 1102 receives an indication of a user interaction with the foundation. Examples of user interaction with a foundation are discussed above and below.
- Step 1104 renders a flyout.
- a flyout can be rendered responsive to receiving the indication of the user interaction with the foundation and/or the flyout can replace the foundation in a display view.
- Step 1106 receives an indication of a focus shift away from the flyout. For example, a cursor that is hovered over the flyout can be moved away from the flyout.
- the method can return to step 1100 .
- FIG. 12 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- the method can be implemented to present information about a visual entity included in a cluster.
- Step 1200 renders a flyout.
- Step 1202 receives an indication of a user interaction with a visual entity included in the flyout. Examples of user interaction are discussed above and below.
- Step 1204 presents information about the visual entity responsive to receiving the indication of the user interaction.
- the determination of visual entities to include in a cluster can be made using visual entities that are included in a display view during a current render pass.
- a user interaction with a foundation can cause a zoom-in operation that reveals individual entities included in a cluster. For example, when a user interacts with a foundation included as part of a display view, the display view can automatically zoom-in on the area of the foundation such that the visual entities represented by the foundation no longer overlap and are displayed as separate visual entities.
- user interaction with a foundation can cause a list of entities represented by the foundation to be presented.
- a list of entities represented by the foundation can be displayed in a window that is included as part of or is adjacent to the display view.
- overlapping visual entities can be represented via a combined visual entity.
- overlapping visual entities can be associated with multiple data sets that can be layered to create a display view. For example, as discussed above with respect to a mapping scenario, multiple layers of map data can be overlaid to generate a particular map view. To aid in visualizing multiple layered data sets, annotations for visual entities can be utilized.
- FIG. 13 illustrates one example implementation of using annotations to visualize multiple layers of data sets according to some embodiments.
- a first layer view which includes multiple visual entities is illustrated generally at 1300 .
- first layer view 1300 includes multiple visual entities that represent restaurants in a particular geographical area, as illustrated by the “R” icons.
- a second layer view is illustrated generally at 1302 and includes multiple visual entities that are different from those illustrated in first layer view 1300 .
- second layer view 1302 includes multiple visual entities that represent business entities that accept a particular payment method (e.g., a particular credit card), as illustrated by the “$” icons.
- a particular payment method e.g., a particular credit card
- An overlapping layer view is illustrated generally at 1304 and includes visual entities from first layer view 1300 and second layer view 1302 , as well as combined visual entities that represent overlap between the layer views.
- a combined visual entity 1306 represents overlap between first layer view 1300 and second layer view 1302 .
- combined visual entity 1306 represents a restaurant that accepts the particular payment method indicated by the “$” symbol.
- the visual entity that represents a restaurant is annotated with the “$” symbol to indicate overlap between the different layers.
- methods discussed above for forming clusters can be utilized to determine when annotations should be used to indicate overlapping data sets.
- the technique discussed above with respect to FIG. 8 can be utilized to determine that visual entities associated with multiple different data sets overlap.
- a visual entity can be displayed with annotations to indicate the overlap of the multiple visual entities.
- a combined visual entity can include a foundation.
- a foundation can be displayed with annotations to visually indicate that multiple visual entities (e.g., in multiple data layers) overlap.
- a flyout can be presented that displays the separate visual entities that are represented by the annotated foundation.
- FIG. 14 displays an example combined visual entity in accordance with some embodiments, generally at 1400 .
- Combined visual entity 1400 includes a primary visualization 1402 and annotations 1404 , 1406 , and 1408 .
- primary visualization 1402 represents a business entity associated with lodging.
- the annotations represent other data layers that overlap with the primary visualization 1402 .
- annotation 1404 represent a coffee shop
- annotation 1406 represents an entity that accepts a particular payment method
- annotation 1408 represents a dining establishment.
- combined visual entity 1400 presents a visual indication of an overlap between these particular data sets.
- color can also be used as a visual indicator for a combined visual entity.
- a particular color can be associated with a particular overlap of visual entities and/or data layers and can indicate to a viewer that the combined visual entity represents the particular visual entities.
- FIG. 15 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- the method can be implemented to register visualizations that can be used to indicate overlapping data sets.
- Step 1500 registers a default visualization for a visual entity.
- the default visualization can be used when the visual entity is a primary visualization for a particular region of a display view.
- Step 1502 registers an annotation for the visual entity.
- the annotation can be used to annotate a primary visualization for a different visual entity to indicate overlap between the visual entity and the different visual entity.
- FIG. 16 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- visual entities may be associated with different layers of data.
- the method can be utilized to render a combined visual representation of entities from multiple different data layers.
- Step 1600 ascertains a position for each visual entity to be rendered. As discussed above, in some embodiments the position can be in terms of a screen position (e.g., an x-coordinate, a y-coordinate, and so on), geographical coordinates, and so on.
- Step 1602 determines that multiple visual entities overlap.
- Step 1604 retrieves a visualization for each of the overlapping visual entities.
- the visualization for each entity can be a primary visualization and/or an annotation.
- Step 1606 renders a combined visual entity that includes visualizations for the multiple overlapping visual entities.
- the combined visual entity can include a primary visualization for one of the overlapping visual entities and one or more annotations for others of the overlapping visual entities.
- FIG. 17 is a flow diagram that describes steps in a method in accordance with one or more embodiments.
- Step 1700 determines that multiple visual entities overlap.
- Step 1702 renders a combined visual entity that includes visualizations for the multiple overlapping visual entities.
- the combined visual entity can include a primary visualization and one or more annotations.
- Step 1704 receives an indication of a zoom-in operation.
- the zoom-in operation can occur responsive to user interaction with an application such as a mapping application.
- Step 1706 determines that a visual entity of the multiple overlapping visual entities no longer overlaps.
- Step 1708 removes the visual entity from the combined visual entity. In some embodiments, this step can include removing an annotation from the combined visual entity or replacing a primary visualization associated with the combined visual entity.
- clusters can be formed that represent groups of data files, instances of media content, flow charts, schematics, groups of persons at a particular location, and/or other entities to which the methods, techniques, and visualizations discussed herein can be applied.
- FIG. 18 illustrates an example computing device 1800 that can be used to implement the various embodiments described above.
- Computing device 1800 can be, for example, computing device 102 of FIG. 1 or any other suitable computing device.
- Computing device 1800 includes one or more processors or processing units 1802 , one or more memory and/or storage components 1804 , one or more input/output (I/O) devices 1806 , and a bus 1808 that allows the various components and devices to communicate with one another.
- Bus 1808 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures.
- Bus 1808 can include wired and/or wireless buses.
- Memory/storage component 1804 represents one or more computer storage media.
- Component 1804 can include volatile media (such as random access memory (RAM)) and/or nonvolatile media (such as read only memory (ROM), Flash memory, optical disks, magnetic disks, and so forth).
- Component 1804 can include fixed media (e.g., RAM, ROM, a fixed hard drive, etc.) as well as removable media (e.g., a Flash memory drive, a removable hard drive, an optical disk, and so forth).
- One or more input/output devices 1806 allow a user to enter commands and information to computing device 1800 , and also allow information to be presented to the user and/or other components or devices.
- Examples of input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone, a scanner, and so forth.
- Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, and so forth.
- Computer readable media can be any available medium or media that can be accessed by a computing device.
- Computer readable media may comprise “computer-readable storage media”.
- Computer-readable storage media include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules, or other data.
- Computer-readable storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer.
- computer readable media may include signals per se
- computer-readable storage media does not include signals per se.
- a cluster is represented on a map or other application display by a visual representation known as a foundation.
- a user can interact with the foundation to cause the cluster to be opened to reveal a flyout that includes individual entities (e.g., geographic locations) that form the cluster.
- a user can also interact with an individual entity of the flyout to acquire more information about the individual entity.
- a foundation can be annotated to indicate one or more entities in a cluster.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Ecology (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Business, Economics & Management (AREA)
- Mathematical Physics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Human Computer Interaction (AREA)
- Mechanical Engineering (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
- This application is a continuation of and claims priority to U.S. application Ser. No. 14/699,104, filed on Apr. 19, 2015, entitled “REPRESENTATION OF OVERLAPPING VISUAL ENTITIES,” which is a divisional of and claims priority to U.S. application Ser. No. 13/826,617, filed on Mar. 14, 2013, entitled “REPRESENTATION OF OVERLAPPING VISUAL ENTITIES,” now issued U.S. Pat. No. 9,043,723, which is a continuation of and claims priority to U.S. application Ser. No. 12/764,798, filed on Apr. 21, 2010, entitled “REPRESENTATION OF OVERLAPPING VISUAL ENTITIES,” now issued U.S. Pat. No. 8,423,902, the disclosures of which are incorporated in their entirety by reference herein.
- Due to the massive amount of data available for consumption in today's electronic environment, data visualization can be problematic. For example, a mapping application can have access to a multitude of locations (e.g., restaurants, banks, hotels, parks, and so on) that can be displayed as part of a map view. The sheer number of locations available for display, however, can cause a particular map view to become cluttered and reduce the usability of the map view.
- This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
- Various embodiments present a combined visual entity that represents overlapping visual entities. The combined visual entity can include a primary visualization that represents one of the overlapping visual entities and annotations that represent others of the overlapping visual entities. For example, a map view can include multiple geographical entities that overlap. A primary visualization can be rendered that represents one of the multiple geographical entities. The primary visualization can be visually annotated (e.g., with symbols, letters, or other visual indicators) to indicate others of the multiple geographical entities. In some embodiments, a zoom operation can cause visual entities to be added and/or removed from the combined visual entity.
- In some embodiments, overlapping visual entities are grouped into a cluster that can be opened to reveal individual visual entities that form the cluster. According to one or more embodiments, a cluster is represented on a map by a visual representation known as a foundation. A user can interact with the foundation to cause the cluster to be opened to reveal a flyout that includes individual visual entities that form the cluster. In some embodiments, the visual entities can represent geographical locations in a map view. A user can also interact with an individual visual entity of the flyout to acquire more information about the visual entity.
- The same numbers are used throughout the drawings to reference like features.
-
FIG. 1 illustrates an operating environment in which various principles described herein can be employed in accordance with one or more embodiments. -
FIG. 2 illustrates how a cluster of visual entities can be visualized in accordance with one or more embodiments. -
FIG. 3 illustrates how a foundation can be expanded to reveal a flyout in accordance with one or more embodiments. -
FIG. 4 illustrates how a foundation can be used to illustrate a cluster in a street view scenario in accordance with one or more embodiments. -
FIG. 5 illustrates how interaction with a flyout can cause information about a flyout entity to be presented in accordance with one or more embodiments. -
FIG. 6 illustrates how interaction with a flyout can cause information about a flyout entity to be presented in accordance with one or more embodiments. -
FIG. 7 is a flow diagram that describes steps in a method in accordance with one or more embodiments. -
FIG. 8 is a flow diagram that describes steps in a method in accordance with one or more embodiments. -
FIG. 9 is a flow diagram that describes steps in a method in accordance with one or more embodiments. -
FIG. 10 is a flow diagram that describes steps in a method in accordance with one or more embodiments. -
FIG. 11 is a flow diagram that describes steps in a method in accordance with one or more embodiments. -
FIG. 12 is a flow diagram that describes steps in a method in accordance with one or more embodiments. -
FIG. 13 illustrates how overlapping data sets can be visualized in accordance with one or more embodiments. -
FIG. 14 illustrates an example combined visual entity in accordance with one or more embodiments. -
FIG. 15 is a flow diagram that describes steps in a method in accordance with one or more embodiments. -
FIG. 16 is a flow diagram that describes steps in a method in accordance with one or more embodiments. -
FIG. 17 is a flow diagram that describes steps in a method in accordance with one or more embodiments. -
FIG. 18 illustrates an example system that can be used to implement one or more embodiments. - Various embodiments present a combined visual entity that represents overlapping visual entities. The combined visual entity can include a primary visualization that represents one of the overlapping visual entities and annotations that represent others of the overlapping visual entities. For example, a map view can include multiple geographical entities that overlap. A primary visualization can be rendered that represents one of the multiple geographical entities. The primary visualization can be visually annotated (e.g., with symbols, letters, or other visual indicators) to indicate others of the multiple geographical entities. In some embodiments, a zoom operation can cause visual entities to be added and/or removed from the combined visual entity.
- In some embodiments, overlapping visual entities are grouped into a cluster that can be opened to reveal the individual visual entities that form the cluster. A visual entity can represent a data entity, such as a geographical location, a business, a residence, an instance of content, a data file, and so on. In some example operating scenarios, overlapping visual entities can represent geographical locations on a map that are combined to form a cluster, and the cluster can be opened to reveal the individual geographical locations that form the cluster. In at least some embodiments, the cluster can be opened independent of a zoom operation. According to one or more embodiments, a cluster is represented on a map by a visual representation known as a foundation. A user can interact with the foundation to cause the cluster to be opened to reveal a flyout that includes individual visual entities (e.g., geographic locations) that form the cluster. A user can also interact with an individual entity of the flyout to acquire more information about the entity. In at least some embodiments, user interaction can include hovering operations, proximity operations (e.g., user interaction within a certain proximity of a foundation or other entity), clicking operations, keyboard selection operations, touch operations, and the like.
- In the discussion that follows, a section entitled “Operating Environment” is provided and describes one example environment in which one or more embodiments can be employed. Following this, a section entitled “Example Cluster Visualizations” describes how clusters of entities can be visualized in accordance with one or more embodiments. Next, a section entitled “Constructing and Interacting with Clusters” describes how a cluster can be formed and how a visualization of a cluster can be interacted with in accordance with one or more embodiments. Following this, a section entitled “Representation of Overlapping Visual Entities” describes how a combined visualization can be used to visually indicate overlapping data sets in accordance with one or more embodiments. Last, a section entitled “Example System” describes an example system that can be utilized to implement one or more embodiments.
- Consider now an example operating environment in which one or more embodiments can be implemented.
- Operating Environment
-
FIG. 1 illustrates an operating environment in accordance with one or more embodiments, generally at 100.Environment 100 includes acomputing device 102 having one ormore processors 104, one or more computer-readable storage media 106 and one ormore applications 108 that reside on the computer-readable storage media and which are executable by the processor(s). The computer-readable storage media can include, by way of example and not limitation, all forms of volatile and non-volatile memory and/or storage media that are typically associated with a computing device. Such media can include ROM, RAM, flash memory, hard disk, removable media and the like. One specific example of a computing device is shown and described below inFIG. 18 . - In addition,
computing device 102 includes a software application in the form of aweb browser 110. Any suitable web browser can be used examples of which are available from the assignee of this document and others. In addition, computer-readable storage media 106 can include alayer manager 112 and acluster manager 114 that are configured to operate as described below. Each oflayer manager 112 andcluster manager 114 can be implemented as a standalone component that can be utilized byapplications 108 and/orbrowser 110. Alternately or additionally,layer manager 112 and/orcluster manager 114 can be implemented as part ofapplications 108 and/orbrowser 110. Examples ofApplications 108 can include a mapping platform (e.g., utilizing 2D and/or 3D maps), an operating system, a file explorer, and so on. - In operation,
layer manager 112 handles layers of data for theapplications 108. For example, a mapping application can include multiple layers of map data that can be used to populate a map view. Each of the multiple layers can include different types of entities and map data. For example, a first layer may include restaurants, a second layer may include educational institutions, a third layer may include locations defined by an end-user, and so on. In some embodiments, multiple layers can be overlaid, one on another, to create a particular map view. To manage layer data,layer manager 112 is configured to handle a variety of different tasks, such as tracking a location for a visual entity, maintaining different visual forms for a visual entity, managing the z-order (e.g., layer order) of different layers and/or visual entities, and so on. - In at least some embodiments,
cluster manager 114 works in a mapping context to enable various visual entities to be grouped into a cluster. A visual entity can represent a data entity, such as a geographical location, an instance of media content, a data file, and the like. The cluster manager can group visual entities into a cluster by determining overlap between visual entities in a particular display region. When a particular group of visual entities overlap by at least a threshold amount, the group of visual entities can be formed into a cluster. Overlap can be measured using a variety of different metrics, such as screen pixels, world-coordinates (e.g., GPS coordinates, latitude, longitude, and so on), street addresses, and so on. Example ways of determining overlap are discussed below. - According to some embodiments,
layer manager 112 andcluster manager 114 are configured to interact and communicate to group visual entities into clusters and to place visual entities and clusters in a particular display view.Layer manager 112 can providecluster manager 114 with different types of information that can be used by the cluster manager to create and manage clusters. Examples of this information include: - Entity list: This is a list of visual entities and/or data entities in a particular system. For example, in a map scenario, this can include a list of geographic entities and visual representations of the geographic entities that are available to populate a map.
- Visible entities: This is a list of the visual entities that are in a current view. For example, this may include geographical entities that are represented in a current map view.
- Existing clusters: This is a list of clusters that are currently in existence.
- Visual entities: This includes a location and dimension for each visual entity. For example, this information may include a location (e.g., in screen coordinates) and a dimension (e.g., in pixels relative to the screen coordinates) of a visual entity.
- Z-order: This includes a z-order for visual entities, clusters, and/or layers in a particular system. For example, a particular visual entity can have a z-order that indicates that the entity is to be displayed above (e.g., occlude) other visual entities in a display view.
- Entity status: This indicates changes in entity status for a particular render pass. For example, this information can indicate that an entity was added, removed, or changed z-order for a particular render pass. In some embodiments, the term “render pass” refers to a re-draw of entities in a display view. A render pass can occur responsive to changes in a display view, such as a zoom operation, the addition or removal of entities, a change in cluster membership, and so on.
- Layer Membership: This indicates which entities belong to which layer and an order for each of the layers in a layer set.
- In some embodiments,
cluster manager 114 can receive some or all of this information fromlayer manager 112, process the information, and generate further information that can be passed back to the layer manager to populate a particular display view. Examples of this further information can include: - (1) Updated entity list: This can include an updated list of entities (including cluster entities) and a list of entities that were removed from existing clusters.
- (2) Entity layers: This can include a list of layers that include entities included in clusters.
- (3) Cluster membership: This can include an indication of a cluster membership for an entity.
- (4) Entity change: This can include an indication of visual entities and/or clusters that should be added or removed from a display view.
- (5) Cluster z-order: This can include a z-order for entities in a particular cluster.
- (6) Visual elements: This can include a visual representation to be used to represent a cluster. In some embodiments, each of multiple clusters can be associated with a unique visual representation.
- In addition the above-mentioned features,
environment 100 includes anetwork 116, such as the Internet, and one ormore web sites 118 from and to which content can be received and sent. Such content can include map content that can be operated upon bylayer manager 112 and/orcluster manager 114, as described above and below. It is to be appreciated and understood that the layer manager and/or the cluster manager can reside on a server or network-accessible computer, other than computingdevice 102. -
Computing device 102 can be embodied as any suitable computing device such as, by way of example and not limitation, a desktop computer, a portable computer, a handheld computer such as a personal digital assistant (PDA), cell phone, a mobile device, and the like. - Although not expressly illustrated in
FIG. 1 ,environment 100 can include a plug-in framework (e.g., embodied on computing device 102) that enables developers, programmers, and other parties to utilize the techniques and processes discussed herein in separate implementations. - Having described an example operating environment, consider now a discussion of example clusters in accordance with one or more embodiments.
- Example Cluster Visualizations
-
FIG. 2 illustrates one example way in which multiple overlapping visual entities can be visualized as a cluster in a mapping context in accordance with one or more embodiments. Amap view 202 displays a group of visual entities and includes amap region 204. Amap view 206 illustrates a map view that is displayed after a zoom-out operation occurs onmap view 202. Themap view 206 includesmap region 204 as well as additional visual entities. As illustrated inmap view 206, the increase in the map scale resulting from the zoom-out operation has caused visual entities withinmap region 204 to be grouped together such that some visual entities visually occlude other visual entities. - Further illustrated in
FIG. 2 is amap view 208 that includesmap region 204 and afoundation 210. In accordance with some embodiments,foundation 210 is a visual representation of a cluster that is created using visual entities frommap region 204. Thus, the overlapping group of visual entities displayed inmap region 204 ofmap view 206 can be replaced withfoundation 210.Foundation 210 can represent a unified visual representation that a user can interact with to view visual entities included in the cluster and to find out more information about the visual entities. - In some embodiments, a visualization for a foundation can be defined for an application by an application developer and/or the visualization can be selected by an end-user. Thus, at least in some embodiments, a visualization for a foundation is customizable to provide a unique visual appearance for a cluster.
-
FIG. 3 illustrates one example way in which user interaction with a foundation can reveal visual entities that form a cluster in accordance with one or more embodiments. Amap view 300 includes thefoundation 210 discussed above with reference toFIG. 2 . At amap view 302, a user has placed a cursor over the foundation 210 (e.g., by manipulating the cursor with a mouse), which has caused aflyout 304 to replacefoundation 210.Flyout 304 includes visual entities that form the cluster represented byfoundation 210. As illustrated, the visual entities are tied together as part offlyout 304 by graphic lines, indicating that the visual entities represent clustered entities and that the visual entities may not be displayed at a correct location for an underlying data entity. - In some embodiments, a visualization for a flyout can be defined for an application by an application developer and/or the visualization can be selected by an end-user. Thus, at least in some embodiments, a flyout visualization is customizable to provide a unique visual appearance for visual entities in a cluster.
- At a
map view 306, the user has moved the cursor away fromflyout 304, thus causingflyout 304 to be replaced withfoundation 210. Thus, in some embodiments,foundation 210 andflyout 304 have a dynamic relationship that responds to user interaction with the foundation and/or the flyout. -
FIG. 4 illustrates one example way of using a foundation to represent a cluster in a street view paradigm in accordance with one or more embodiments. As part ofFIG. 4 are astreet view 400 and afoundation 402. In some embodiments,street view 400 is a two-dimensional approximation of a three-dimensional view. For example,street view 400 can approximate the view of a person who is traveling (e.g., walking or driving) along a street. In the street view context, some visual entities can occlude other visual entities. For example, if several visual entities are located at the same address (e.g., in an office building), the visual entities can become cluttered and some of the visual entities can partially or totally occlude others. Thus, a foundation/flyout combination (represented by foundation 402) can be used to represent a cluster of visual entities at a particular location instreet view 400. - In some embodiments, the design of a foundation and/or flyout can be configured to convey meaning in a particular context. For example, a visualization for a foundation can include a building at a particular location and an associated flyout can include a map of different locations within the building.
-
FIG. 5 illustrates one example way of interacting with a foundation to view visual entities in a cluster in accordance with one or more embodiments. At 500, afoundation 502 is illustrated. As discussed above and below, in some embodiments a foundation is a visual representation of clustered entities. At 504, user interaction withfoundation 502 causes an underlying cluster to open and reveal aflyout 506. At 508, user interaction with avisual entity 510 reveals information aboutvisual entity 510. In this particular example, the information is included in apopup window 512. - At 514, user interaction with the
popup window 512 causes the popup window to expand and reveal further information about thevisual entity 510. In this particular example embodiment, the further information includes selectable links that can be selected to navigate to functionality associated with the represented entity. -
FIG. 6 illustrates an alternative embodiment of a foundation/flyout combination in accordance with one or more embodiments. At 600, afoundation 602 is displayed that represents a cluster of visual entities. In this particular example embodiment,foundation 602 is annotated to indicate aspects of one or more of the visual entities of the underlying cluster. For example,foundation 602 includes an “R” which indicates that one of the entities is a restaurant, a “C” which indicates that one of the entities is a coffee shop, and a “P” which indicates that one of the entities is associated with parking. - At 604, user interaction with
foundation 602 causes apopup window 606 to be displayed. At 608, a user interacts with thepopup window 606. According to some embodiments, user interaction withpopup window 606 can include causing a cursor to hover over the popup window. At 610, the user interaction withpopup window 606 causes the popup window to expand to reveal more information about visual entities included in the cluster represented byfoundation 602. In this particular example embodiment, the information includes a scrollable list of business entities that are part of the cluster. At 612, user interaction with one of the listed business entities causespopup window 606 to be populated with more information about the business entity. - Constructing and Interacting with Clusters
-
FIG. 7 is a flow diagram that describes steps in a method in accordance with one or more embodiments. The method discussed with reference toFIG. 7 , in addition to any other of the methods discussed herein, can be implemented in connection with any suitable hardware, software, firmware or combination thereof. In at least some embodiments, aspects of the methods discussed herein can be implemented by software modules, such aslayer manager 112 and/orcluster manager 114 discussed inFIG. 1 . It is to be appreciated and understood that the methods discussed herein can be performed by a suitably-configured server, a network-accessible computing device, and/or a client computing device. - Step 700 ascertains visual entities that are available in the system to be displayed. For example, in a mapping scenario, the visual entities can represent geographical locations that can occur in a particular map view. The visual entities can be stored at a local resource (e.g., computing device 102) and/or available from a remote resource. Step 702 determines a location for each visual entity in the system. In some embodiments, the location may be in terms of screen location (e.g., screen coordinates), real-world location (e.g., GPS coordinates, street address, latitude/longitude coordinates, and so on), computer directory location, and so on. Step 704 determines that a group of visual entities forms a cluster. Example ways of performing
step 704 are discussed in more detail below. Step 706 renders a visual representation of the cluster. Example visual representations of a cluster are discussed above (e.g., a foundation) and below. - According to some embodiments, a data entity can opt in or opt out of the clustering process. For example, when a particular data entity opts into the clustering process, a visual entity that represents the data entity will be considered when determining clusters. When a particular data entity opts out of the clustering process, however, a visual entity that represents the data entity will be omitted when determining clusters.
- As an illustration of this notion, consider the following example implementation scenario involving a tourist attraction data entity. When the tourist attraction registers with a particular data layer (e.g., to be included in a map), the tourist attraction provides an indication that it is opting out of the clustering process. When the clustering process is performed for a map region where the tourist attraction occurs, the tourist attraction is not considered in forming a cluster. Thus, according to some embodiments, the clustering process would normally group a visual representation of the tourist attraction with other visual entities to form a cluster. Since the tourist attraction has opted out of the clustering process, however, a visual representation of tourist attraction is not included as part of a cluster, e.g., as part of a foundation. Thus, in some embodiments, a visual representation of the tourist attraction can be rendered separately from an adjacent foundation.
-
FIG. 8 is a flow diagram that describes steps in a method in accordance with one or more embodiments. In some embodiments, the method can be implemented to form a cluster that includes multiple visual entities. Step 800 sorts visual entities to determine x-coordinate overlap. In some embodiments, a configurable x-coordinate threshold overlap can be specified that can be used to determine if two or more visual entities overlap such that they can be members of a cluster. For example, with respect to x-coordinate overlap, a threshold overlap of N pixels can be specified. When two or more visual entities overlap by N pixels or more as projected on an x-axis, the visual entities can be considered an x-pass group for purposes of a preliminary cluster determination. In some embodiments, the acts of sorting discussed above and below can be accomplished in linear time using a linear sort algorithm (e.g., Radix sort). - Step 802 determines x-pass groups based on collections of visual entities that exceed an x-coordinate overlap threshold. As illustrated in the projection from
step 802, the entities withinbox 804 andbox 806 exceed an x-pass overlap threshold and thus are grouped as x-pass groups. Step 808 sorts the x-pass groups by y-coordinate overlap. - Step 810 forms clusters using x-pass groups that include collections of visual entities that exceed a y-coordinate overlap threshold. A configurable threshold y-coordinate overlap can be specified or the threshold x-coordinate overlap discussed above can be utilized in sorting the x-pass groups by y-coordinate overlap. As illustrated in the projection from
step 810, acluster 812 and acluster 814 have been formed as a result ofstep 810. - In some embodiments, a maximum number of visual entities permitted in a cluster can be specified. For example, a maximum of 5 visual entities per cluster can be specified. If a cluster exceeds the maximum number of visual entities, the cluster can be broken up into separate clusters and/or visual entities can be removed from the cluster until it reaches the maximum size. Although not expressly illustrated in
FIG. 8 , a final step can be performed whereby clusters that exceed a maximum number of visual entities can be broken up into multiple clusters (e.g., two or more smaller clusters) and/or visual entities can be removed from a cluster that exceeds a maximum number of visual entities. In some embodiments, visual entities that are removed from a cluster can be displayed separately from a foundation. -
FIG. 9 is a flow diagram that describes steps in a method in accordance with one or more embodiments. In some embodiments, the method can be implemented to form a cluster that includes multiple geographic entities. Examples of geographic entities include street addresses, businesses, residential locations, and so on. Step 900 determines geographic coordinates for each geographic entity of a collection of geographic entities. Examples of geographic coordinates include latitude coordinates, longitude coordinates, GPS coordinates, and so on. Step 902 forms a cluster that includes geographic entities with matching geographic coordinates. One example way of performingstep 902 is to compute a hash value using geographical coordinates for each geographic entity. For example, a one-pass linear bucketing of the geographical coordinates can be performed. Geographic entities with identical and/or similar hash values are then grouped together to form a cluster. - Step 904 renders a visual representation of the cluster. According to some embodiments, this method of forming clusters can be useful in a street view scenario (see, e.g., the discussion above with respect to
FIG. 4 ) to form clusters using geographical entities that occur at the same or similar location (e.g., a particular street address). - The methods discussed herein for determining entity overlap and/or forming clusters are provided for purposes of example only and are not to be interpreted as limiting the claimed subject matter. It is to be appreciated that a variety of different methods and techniques can be utilized to form clusters without departing from the spirit and scope of the claimed embodiments. For example, some techniques can simply look at pixel occlusion, some can consider the shape of entities in forming a cluster (e.g., utilizing a shape collision detection algorithm), and so on.
- While certain embodiments are discussed herein with respect to forming clusters based on entity overlap, some embodiments can additionally or alternatively form clusters utilizing entities that are like or similar in nature. For example, some clustering techniques can form clusters using similar entities, such as a restaurant cluster, a tourist attraction cluster, a coffee shop cluster, and so on. Thus, in some embodiments, a cluster-forming technique can consider the proximity and/or overlap of entities and can also consider the nature of each of the entities. For example, if two entities are of disparate types (e.g., one is a restaurant and the other is a sporting goods store), the two entities may not be included in the same cluster.
-
FIG. 10 is a flow diagram that describes steps in a method in accordance with one or more embodiments. In some embodiments, the method can be implemented to cluster and/or de-cluster entities in response to a zoom operation.Step 1000 receives an indication of an initiation of a zoom level change. According to some embodiments,step 1000 can be performed responsive to user interaction with a zoom (e.g., zoom-in or zoom-out) function.Step 1002 ungroups visual entities that form a first cluster. In some embodiments, the first cluster can be ungrouped responsive to receiving the indication of the zoom level change.Step 1004 receives an indication of completion of the zoom level change. In some embodiments, the zoom level change can include a zoom-in and/or a zoom-out operation. -
Step 1006 determines whether or not the visual entities form a cluster. Example ways of determining that visual entities form a cluster are discussed above and below. If the visual entities form a cluster (“Yes”),step 1008 renders a visual representation of a second cluster. In some embodiments, the second cluster may include the same visual entities as the first cluster, fewer visual entities than the first cluster, or more visual entities than the first cluster. If the visual entities do not form a cluster (“No”),step 1010 renders separate visual entities. -
FIG. 11 is a flow diagram that describes steps in a method in accordance with one or more embodiments.Step 1100 renders a foundation. In some embodiments, the foundation includes a visual representation of a cluster.Step 1102 receives an indication of a user interaction with the foundation. Examples of user interaction with a foundation are discussed above and below.Step 1104 renders a flyout. In some embodiments, a flyout can be rendered responsive to receiving the indication of the user interaction with the foundation and/or the flyout can replace the foundation in a display view.Step 1106 receives an indication of a focus shift away from the flyout. For example, a cursor that is hovered over the flyout can be moved away from the flyout. In some embodiments, and responsive to receiving the indication of the focus shift away from the flyout, the method can return tostep 1100. -
FIG. 12 is a flow diagram that describes steps in a method in accordance with one or more embodiments. In some embodiments, the method can be implemented to present information about a visual entity included in a cluster.Step 1200 renders a flyout.Step 1202 receives an indication of a user interaction with a visual entity included in the flyout. Examples of user interaction are discussed above and below.Step 1204 presents information about the visual entity responsive to receiving the indication of the user interaction. - A number of optional variations and additions to the methods and techniques discussed herein can be implemented to account for various operating scenarios. The following is a non-exclusive list of example optional variations and additions.
- (1) The determination of visual entities to include in a cluster can be made using visual entities that are included in a display view during a current render pass.
- (2) When a z-order for a visual entity or a cluster changes during a render pass, the z-order in existing clusters simply needs to be updated.
- (3) When a change during a render pass simply involves the addition of a visual entity, determine if there is overlap of the added visual entity with existing visual entities.
- (4) When a change during a render pass simply involves a zoom operation, re-cluster using existing clusters.
- (5) For a particular render pass, simply re-render a cluster (e.g., a foundation) if its entity set has changed.
- (6) Locate and remove any duplicate visual entities. For example, if multiple map entries are created for a single business entity, all but one of the entries can be removed from the system.
- While certain embodiments are discussed herein with reference to utilizing a flyout to disambiguate clustered entities, this is not intended to be limiting. In some embodiments, a user interaction with a foundation can cause a zoom-in operation that reveals individual entities included in a cluster. For example, when a user interacts with a foundation included as part of a display view, the display view can automatically zoom-in on the area of the foundation such that the visual entities represented by the foundation no longer overlap and are displayed as separate visual entities.
- Alternatively or additionally, in some embodiments user interaction with a foundation can cause a list of entities represented by the foundation to be presented. For example, when a user interacts with a foundation included as part of a display view, a list of entities represented by the foundation can be displayed in a window that is included as part of or is adjacent to the display view.
- Having described example ways of constructing and interacting with clusters, consider now various embodiments that illustrate example ways of using annotations to indicate overlapping data sets.
- Representation of Overlapping Visual Entities
- In at least some embodiments, overlapping visual entities can be represented via a combined visual entity. In some example scenarios, overlapping visual entities can be associated with multiple data sets that can be layered to create a display view. For example, as discussed above with respect to a mapping scenario, multiple layers of map data can be overlaid to generate a particular map view. To aid in visualizing multiple layered data sets, annotations for visual entities can be utilized.
-
FIG. 13 illustrates one example implementation of using annotations to visualize multiple layers of data sets according to some embodiments. A first layer view which includes multiple visual entities is illustrated generally at 1300. In this particular example,first layer view 1300 includes multiple visual entities that represent restaurants in a particular geographical area, as illustrated by the “R” icons. A second layer view is illustrated generally at 1302 and includes multiple visual entities that are different from those illustrated infirst layer view 1300. In this particular example,second layer view 1302 includes multiple visual entities that represent business entities that accept a particular payment method (e.g., a particular credit card), as illustrated by the “$” icons. An overlapping layer view is illustrated generally at 1304 and includes visual entities fromfirst layer view 1300 andsecond layer view 1302, as well as combined visual entities that represent overlap between the layer views. For example, a combinedvisual entity 1306 represents overlap betweenfirst layer view 1300 andsecond layer view 1302. In some embodiments, combinedvisual entity 1306 represents a restaurant that accepts the particular payment method indicated by the “$” symbol. In this particular example embodiment, the visual entity that represents a restaurant is annotated with the “$” symbol to indicate overlap between the different layers. - In at least some embodiments, methods discussed above for forming clusters can be utilized to determine when annotations should be used to indicate overlapping data sets. For example, the technique discussed above with respect to
FIG. 8 can be utilized to determine that visual entities associated with multiple different data sets overlap. A visual entity can be displayed with annotations to indicate the overlap of the multiple visual entities. - In some embodiments, a combined visual entity can include a foundation. For example, a foundation can be displayed with annotations to visually indicate that multiple visual entities (e.g., in multiple data layers) overlap. Responsive to a user interaction with the annotated foundation, a flyout can be presented that displays the separate visual entities that are represented by the annotated foundation.
-
FIG. 14 displays an example combined visual entity in accordance with some embodiments, generally at 1400. Combinedvisual entity 1400 includes aprimary visualization 1402 andannotations primary visualization 1402 represents a business entity associated with lodging. The annotations represent other data layers that overlap with theprimary visualization 1402. For example,annotation 1404 represent a coffee shop,annotation 1406 represents an entity that accepts a particular payment method, andannotation 1408 represents a dining establishment. Thus, combinedvisual entity 1400 presents a visual indication of an overlap between these particular data sets. - Alternatively or additionally to the symbol and/or character-based annotation of a combined visually entity, color can also be used as a visual indicator for a combined visual entity. For example, a particular color can be associated with a particular overlap of visual entities and/or data layers and can indicate to a viewer that the combined visual entity represents the particular visual entities.
-
FIG. 15 is a flow diagram that describes steps in a method in accordance with one or more embodiments. In some embodiments, the method can be implemented to register visualizations that can be used to indicate overlapping data sets.Step 1500 registers a default visualization for a visual entity. According to some embodiments, the default visualization can be used when the visual entity is a primary visualization for a particular region of a display view.Step 1502 registers an annotation for the visual entity. In some embodiments, the annotation can be used to annotate a primary visualization for a different visual entity to indicate overlap between the visual entity and the different visual entity. -
FIG. 16 is a flow diagram that describes steps in a method in accordance with one or more embodiments. As discussed above, in some embodiments visual entities may be associated with different layers of data. Thus, at least in some embodiments the method can be utilized to render a combined visual representation of entities from multiple different data layers.Step 1600 ascertains a position for each visual entity to be rendered. As discussed above, in some embodiments the position can be in terms of a screen position (e.g., an x-coordinate, a y-coordinate, and so on), geographical coordinates, and so on.Step 1602 determines that multiple visual entities overlap.Step 1604 retrieves a visualization for each of the overlapping visual entities. The visualization for each entity can be a primary visualization and/or an annotation.Step 1606 renders a combined visual entity that includes visualizations for the multiple overlapping visual entities. In some embodiments, the combined visual entity can include a primary visualization for one of the overlapping visual entities and one or more annotations for others of the overlapping visual entities. -
FIG. 17 is a flow diagram that describes steps in a method in accordance with one or more embodiments.Step 1700 determines that multiple visual entities overlap.Step 1702 renders a combined visual entity that includes visualizations for the multiple overlapping visual entities. In some embodiments, the combined visual entity can include a primary visualization and one or more annotations. -
Step 1704 receives an indication of a zoom-in operation. In at least some embodiments, the zoom-in operation can occur responsive to user interaction with an application such as a mapping application.Step 1706 determines that a visual entity of the multiple overlapping visual entities no longer overlaps.Step 1708 removes the visual entity from the combined visual entity. In some embodiments, this step can include removing an annotation from the combined visual entity or replacing a primary visualization associated with the combined visual entity. - While several of the example embodiments discussed herein are discussed with respect to a map implementation, it is to be appreciated that methods, techniques, and visualizations discussed herein can be applied in other scenarios without departing from the spirit and scope of the claimed embodiments. For example, clusters can be formed that represent groups of data files, instances of media content, flow charts, schematics, groups of persons at a particular location, and/or other entities to which the methods, techniques, and visualizations discussed herein can be applied.
- Example System
-
FIG. 18 illustrates anexample computing device 1800 that can be used to implement the various embodiments described above.Computing device 1800 can be, for example,computing device 102 ofFIG. 1 or any other suitable computing device. -
Computing device 1800 includes one or more processors orprocessing units 1802, one or more memory and/orstorage components 1804, one or more input/output (I/O)devices 1806, and abus 1808 that allows the various components and devices to communicate with one another.Bus 1808 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures.Bus 1808 can include wired and/or wireless buses. - Memory/
storage component 1804 represents one or more computer storage media.Component 1804 can include volatile media (such as random access memory (RAM)) and/or nonvolatile media (such as read only memory (ROM), Flash memory, optical disks, magnetic disks, and so forth).Component 1804 can include fixed media (e.g., RAM, ROM, a fixed hard drive, etc.) as well as removable media (e.g., a Flash memory drive, a removable hard drive, an optical disk, and so forth). - One or more input/
output devices 1806 allow a user to enter commands and information tocomputing device 1800, and also allow information to be presented to the user and/or other components or devices. Examples of input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone, a scanner, and so forth. Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, and so forth. - Various techniques may be described herein in the general context of software or program modules. Generally, software includes routines, programs, objects, components, data structures, and so forth that perform particular tasks or implement particular abstract data types. An implementation of these modules and techniques may be stored on or transmitted across some form of computer readable media. Computer readable media can be any available medium or media that can be accessed by a computing device. By way of example, and not limitation, computer readable media may comprise “computer-readable storage media”.
- “Computer-readable storage media” include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules, or other data. Computer-readable storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. Thus, whereas computer readable media may include signals per se, computer-readable storage media does not include signals per se.
- Various embodiments enable overlapping visual entities to be grouped into a cluster that can be opened to reveal individual entities that form the cluster. According to one or more embodiments, a cluster is represented on a map or other application display by a visual representation known as a foundation. A user can interact with the foundation to cause the cluster to be opened to reveal a flyout that includes individual entities (e.g., geographic locations) that form the cluster. A user can also interact with an individual entity of the flyout to acquire more information about the individual entity. In at least some embodiments, a foundation can be annotated to indicate one or more entities in a cluster.
- Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
Claims (21)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/459,976 US20170186206A1 (en) | 2010-04-21 | 2017-03-15 | Representation of overlapping visual entities |
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/764,798 US8423902B2 (en) | 2010-04-21 | 2010-04-21 | Representation of overlapping visual entities |
US13/826,617 US9043723B2 (en) | 2010-04-21 | 2013-03-14 | Representation of overlapping visual entities |
US14/699,104 US9449581B2 (en) | 2010-04-21 | 2015-04-29 | Representation of overlapping visual entities |
US15/163,849 US9620085B2 (en) | 2010-04-21 | 2016-05-25 | Representation of overlapping visual entities |
US15/459,976 US20170186206A1 (en) | 2010-04-21 | 2017-03-15 | Representation of overlapping visual entities |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/163,849 Continuation US9620085B2 (en) | 2010-04-21 | 2016-05-25 | Representation of overlapping visual entities |
Publications (1)
Publication Number | Publication Date |
---|---|
US20170186206A1 true US20170186206A1 (en) | 2017-06-29 |
Family
ID=44816851
Family Applications (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/764,798 Active 2030-10-09 US8423902B2 (en) | 2010-04-21 | 2010-04-21 | Representation of overlapping visual entities |
US13/826,617 Active US9043723B2 (en) | 2010-04-21 | 2013-03-14 | Representation of overlapping visual entities |
US14/699,104 Active US9449581B2 (en) | 2010-04-21 | 2015-04-29 | Representation of overlapping visual entities |
US15/163,849 Active US9620085B2 (en) | 2010-04-21 | 2016-05-25 | Representation of overlapping visual entities |
US15/459,976 Abandoned US20170186206A1 (en) | 2010-04-21 | 2017-03-15 | Representation of overlapping visual entities |
Family Applications Before (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/764,798 Active 2030-10-09 US8423902B2 (en) | 2010-04-21 | 2010-04-21 | Representation of overlapping visual entities |
US13/826,617 Active US9043723B2 (en) | 2010-04-21 | 2013-03-14 | Representation of overlapping visual entities |
US14/699,104 Active US9449581B2 (en) | 2010-04-21 | 2015-04-29 | Representation of overlapping visual entities |
US15/163,849 Active US9620085B2 (en) | 2010-04-21 | 2016-05-25 | Representation of overlapping visual entities |
Country Status (2)
Country | Link |
---|---|
US (5) | US8423902B2 (en) |
CN (1) | CN102237011B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10373290B2 (en) * | 2017-06-05 | 2019-08-06 | Sap Se | Zoomable digital images |
Families Citing this family (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8423902B2 (en) | 2010-04-21 | 2013-04-16 | Microsoft Corporation | Representation of overlapping visual entities |
KR20120020010A (en) * | 2010-08-27 | 2012-03-07 | 삼성전자주식회사 | Method and apparatus for displaying contents |
JP5454487B2 (en) * | 2011-02-17 | 2014-03-26 | トヨタ自動車株式会社 | Map information display device |
USD717813S1 (en) * | 2011-07-25 | 2014-11-18 | Facebook, Inc. | Display panel of a programmed computer system with a graphical user interface |
US9406153B2 (en) * | 2011-12-14 | 2016-08-02 | Microsoft Technology Licensing, Llc | Point of interest (POI) data positioning in image |
WO2013136447A1 (en) * | 2012-03-13 | 2013-09-19 | パイオニア株式会社 | Display information generation device, display information generation method, display information generation program, and information recording medium |
US20130339868A1 (en) * | 2012-05-30 | 2013-12-19 | Hearts On Fire Company, Llc | Social network |
WO2014025472A1 (en) * | 2012-08-09 | 2014-02-13 | Itron, Inc. | Interface for clustered utility nodes |
USD759034S1 (en) * | 2013-02-01 | 2016-06-14 | Samsung Electronics Co., Ltd. | Display screen or portion thereof with graphical user interface |
US9047847B2 (en) | 2013-02-05 | 2015-06-02 | Facebook, Inc. | Displaying clusters of media items on a map using representative media items |
US9134886B2 (en) | 2013-02-07 | 2015-09-15 | Google Inc. | Providing indoor facility information on a digital map |
US9927949B2 (en) * | 2013-05-09 | 2018-03-27 | Amazon Technologies, Inc. | Recognition interfaces for computing devices |
EP2818832A3 (en) * | 2013-06-26 | 2015-03-04 | Robert Bosch Gmbh | Method, apparatus and device for representing POI on a map |
USD764537S1 (en) * | 2013-08-01 | 2016-08-23 | Sears Brands, L.L.C. | Display screen or portion thereof with an icon |
USD759038S1 (en) * | 2013-08-01 | 2016-06-14 | Sears Brands, L.L.C. | Display screen or portion thereof with icon |
USD739436S1 (en) * | 2013-08-29 | 2015-09-22 | Sears Brands, L.L.C. | Display screen or portion thereof with animated graphical user interface |
USD745046S1 (en) | 2013-10-25 | 2015-12-08 | Microsoft Corporation | Display screen with animated graphical user interface |
US10796012B2 (en) * | 2013-11-06 | 2020-10-06 | Intel Corporation | Unifying interface for cloud content sharing services |
USD753716S1 (en) | 2013-11-21 | 2016-04-12 | Microsoft Corporation | Display screen with icon |
USD774061S1 (en) * | 2014-03-12 | 2016-12-13 | Tencent Technology (Shenzhen) Company Limited | Portion of a display screen with graphical user interface |
US9594773B2 (en) | 2014-05-20 | 2017-03-14 | Vesmir, Inc. | Pattern-retaining method for displaying large volumes of geographic based data using statistical depopulation |
USD773529S1 (en) * | 2014-11-14 | 2016-12-06 | Dexcom, Inc. | Display screen or portion thereof with icon for presentation of analyte data |
USD821495S1 (en) | 2015-12-04 | 2018-06-26 | Harry Stewart Knapp | Directional sign |
US10366528B2 (en) | 2015-12-08 | 2019-07-30 | Amazon Technologies, Inc. | Interactive points of interest for 3D-representations |
CN106897321B (en) * | 2015-12-21 | 2020-06-05 | 北京国双科技有限公司 | Method and device for displaying map data |
US9927951B2 (en) * | 2015-12-21 | 2018-03-27 | Sap Se | Method and system for clustering icons on a map |
US11256758B2 (en) * | 2018-08-03 | 2022-02-22 | Sap Se | System and method for rendering overlapping points |
US11545118B2 (en) * | 2021-05-19 | 2023-01-03 | Business Objects Software Ltd. | Display of out-of-window status indicators in a virtual shelf of a diagram window |
US20220382802A1 (en) * | 2021-06-01 | 2022-12-01 | Google Llc | Smart suggestions for image zoom regions |
CN116340405B (en) * | 2023-03-29 | 2023-10-13 | 北京科乐园网络科技有限公司 | Enterprise data processing method, device, equipment and storage medium based on big data |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7076741B2 (en) * | 2001-03-16 | 2006-07-11 | Alpine Electronics, Inc. | Point-of-interest icon and point-of-interest mark display method |
US20060215923A1 (en) * | 2005-03-25 | 2006-09-28 | Microsoft Corporation | Lossless compression algorithms for spatial data |
US20070268310A1 (en) * | 2006-05-18 | 2007-11-22 | Dolph Blaine H | Method and Apparatus for Consolidating Overlapping Map Markers |
US20090055774A1 (en) * | 2007-08-08 | 2009-02-26 | Steffen Joachim | Method For Operating A Navigation System |
US20110010650A1 (en) * | 2009-07-09 | 2011-01-13 | Mapquest, Inc. | Systems and methods for decluttering electronic map displays |
US20110047509A1 (en) * | 2009-08-18 | 2011-02-24 | Nokia Corporation | Method and apparatus for grouping points-of-interest on a map |
US20110161875A1 (en) * | 2009-12-29 | 2011-06-30 | Nokia Corporation | Method and apparatus for decluttering a mapping display |
Family Cites Families (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5553209A (en) * | 1994-01-28 | 1996-09-03 | Hughes Aircraft Company | Method for automatically displaying map symbols |
JP3568621B2 (en) * | 1995-04-20 | 2004-09-22 | 株式会社日立製作所 | Map display device |
US5787422A (en) | 1996-01-11 | 1998-07-28 | Xerox Corporation | Method and apparatus for information accesss employing overlapping clusters |
US5790121A (en) | 1996-09-06 | 1998-08-04 | Sklar; Peter | Clustering user interface |
JP2001109760A (en) * | 1999-10-06 | 2001-04-20 | Toshiba Corp | Device for displaying geographical information and storage medium with program executing the same stored therein |
US6204844B1 (en) | 1999-10-08 | 2001-03-20 | Motorola, Inc. | Method and apparatus for dynamically grouping communication units in a communication system |
CA2454778A1 (en) | 2001-07-06 | 2003-01-16 | Computer Associates Think, Inc. | System and method for managing object based clusters |
US7076505B2 (en) * | 2002-07-11 | 2006-07-11 | Metrobot Llc | Method, apparatus, and computer program product for providing a graphical user interface with a linear map component |
US6856901B2 (en) * | 2003-06-02 | 2005-02-15 | Alpine Electronics, Inc. | Display method and apparatus for navigation system |
US7668649B2 (en) * | 2003-10-16 | 2010-02-23 | Alpine Electronics, Inc. | Display method and apparatus for navigation system |
US8190357B2 (en) | 2006-03-17 | 2012-05-29 | Google Inc. | Multi-occupant structure in a geo-spatial environment |
JP2009545799A (en) | 2006-08-02 | 2009-12-24 | コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ | How to combine binary cluster maps into a single cluster map |
JP2008102467A (en) | 2006-10-19 | 2008-05-01 | Kokusai Kogyo Co Ltd | Sign object display system |
US20080250337A1 (en) * | 2007-04-05 | 2008-10-09 | Nokia Corporation | Identifying interesting locations based on commonalities in location based postings |
US20080281869A1 (en) | 2007-05-07 | 2008-11-13 | Enowhiring, Inc. | Apparatus and Method Of Map Engine Clustering Automation |
US20080281854A1 (en) | 2007-05-07 | 2008-11-13 | Fatdoor, Inc. | Opt-out community network based on preseeded data |
US7889888B2 (en) | 2007-06-27 | 2011-02-15 | Raytheon Company | System and method for grouping and visualizing data |
US8671355B2 (en) | 2007-10-05 | 2014-03-11 | Mapquest, Inc. | Methods and systems for decluttering icons representing points of interest on a map |
US8504945B2 (en) * | 2008-02-01 | 2013-08-06 | Gabriel Jakobson | Method and system for associating content with map zoom function |
US8467991B2 (en) | 2008-06-20 | 2013-06-18 | Microsoft Corporation | Data services based on gesture and location information of device |
US8627192B2 (en) * | 2008-07-03 | 2014-01-07 | Ebay Inc. | System and methods for automatic media population of a style presentation |
US8401771B2 (en) | 2008-07-22 | 2013-03-19 | Microsoft Corporation | Discovering points of interest from users map annotations |
US8595638B2 (en) * | 2008-08-28 | 2013-11-26 | Nokia Corporation | User interface, device and method for displaying special locations on a map |
US8060510B2 (en) * | 2009-02-13 | 2011-11-15 | Yahoo! Inc. | Best fit map searching |
US9218360B2 (en) | 2009-12-11 | 2015-12-22 | Microsoft Technology Licensing, Llc | User-selected tags for annotating geographic domains containing points-of-interest |
US8423902B2 (en) | 2010-04-21 | 2013-04-16 | Microsoft Corporation | Representation of overlapping visual entities |
US20110265023A1 (en) | 2010-04-21 | 2011-10-27 | Microsoft Corporation | Interactive Representation of Clustered Entities |
-
2010
- 2010-04-21 US US12/764,798 patent/US8423902B2/en active Active
-
2011
- 2011-04-20 CN CN201110111552.6A patent/CN102237011B/en active Active
-
2013
- 2013-03-14 US US13/826,617 patent/US9043723B2/en active Active
-
2015
- 2015-04-29 US US14/699,104 patent/US9449581B2/en active Active
-
2016
- 2016-05-25 US US15/163,849 patent/US9620085B2/en active Active
-
2017
- 2017-03-15 US US15/459,976 patent/US20170186206A1/en not_active Abandoned
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7076741B2 (en) * | 2001-03-16 | 2006-07-11 | Alpine Electronics, Inc. | Point-of-interest icon and point-of-interest mark display method |
US20060215923A1 (en) * | 2005-03-25 | 2006-09-28 | Microsoft Corporation | Lossless compression algorithms for spatial data |
US20070268310A1 (en) * | 2006-05-18 | 2007-11-22 | Dolph Blaine H | Method and Apparatus for Consolidating Overlapping Map Markers |
US20090055774A1 (en) * | 2007-08-08 | 2009-02-26 | Steffen Joachim | Method For Operating A Navigation System |
US20110010650A1 (en) * | 2009-07-09 | 2011-01-13 | Mapquest, Inc. | Systems and methods for decluttering electronic map displays |
US20110047509A1 (en) * | 2009-08-18 | 2011-02-24 | Nokia Corporation | Method and apparatus for grouping points-of-interest on a map |
US20110161875A1 (en) * | 2009-12-29 | 2011-06-30 | Nokia Corporation | Method and apparatus for decluttering a mapping display |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10373290B2 (en) * | 2017-06-05 | 2019-08-06 | Sap Se | Zoomable digital images |
Also Published As
Publication number | Publication date |
---|---|
US20160267880A1 (en) | 2016-09-15 |
CN102237011A (en) | 2011-11-09 |
US20110265030A1 (en) | 2011-10-27 |
US9620085B2 (en) | 2017-04-11 |
US20150235623A1 (en) | 2015-08-20 |
US9449581B2 (en) | 2016-09-20 |
CN102237011B (en) | 2016-03-23 |
US8423902B2 (en) | 2013-04-16 |
US20130194258A1 (en) | 2013-08-01 |
US9043723B2 (en) | 2015-05-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9620085B2 (en) | Representation of overlapping visual entities | |
US20110265023A1 (en) | Interactive Representation of Clustered Entities | |
US10996823B2 (en) | Interactive geospatial map | |
US7456848B2 (en) | Method for consolidating overlapping map markers | |
US20170205985A1 (en) | Expanding a 3d stack of floor maps at a rate proportional to a speed of a pinch gesture | |
US9417777B2 (en) | Enabling quick display transitions between indoor and outdoor map data | |
US8294710B2 (en) | Extensible map with pluggable modes | |
US8423914B2 (en) | Selection user interface | |
EP3133510A1 (en) | Interactive geospatial map | |
EP2954468B1 (en) | Providing indoor facility information on a digital map | |
US9697751B2 (en) | Interactive representation of clusters of geographical entities | |
US20130249812A1 (en) | Interactive visual representation of points of interest data | |
US20110084967A1 (en) | Visualization of Datasets | |
US20090307618A1 (en) | Annotate at multiple levels | |
CN110741229B (en) | Dynamically changing visual attributes of indicators on digital maps | |
JP4774560B2 (en) | MAP DISPLAY CONTROL DEVICE, MAP DISPLAY CONTROL METHOD, MAP DISPLAY CONTROL PROGRAM, AND INFORMATION RECORDING MEDIUM | |
WO2014036216A1 (en) | Display error indications | |
CN110609878A (en) | Interest point information display method, device, server and storage medium | |
JP5402160B2 (en) | Map display device, map display method and program | |
JP2000181344A (en) | Map display system and scroll processing method therein |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
AS | Assignment |
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:051222/0169 Effective date: 20141014 Owner name: MICROSOFT CORPORATION, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LIN, JEFF J.;LOOMIS, ANNE H.;IMPAS, ROMUALDO T.;AND OTHERS;SIGNING DATES FROM 20100408 TO 20100419;REEL/FRAME:051222/0099 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |