CA2631828C - Timescale for presenting documents - Google Patents

Abstract

A computer-readable medium including computer-executable instructions providing a method of displaying arrays of computer-readable files, the method comprising causing a first array of computer-readable files to be displayed, said first array of computer-readable files being displayed along a timeline according to a first timescale; causing a second array of computer-readable files to be displayed, said second array of computer-readable files being displayed along a timeline according to a second timescale. An interface, a computerized system and a method for providing same is also disclosed therein.

Description

2

3

4 BACKGROUND OF THE INVENTION
6 1. Field of the Invention 7 [02] This invention relates generally to computer systems and more 8 specifically to user interfaces for computer systems that facilitates localization 9 and organization of documents along timelines.
11 2. Description of the Related Art 12 [03] United States Patent Application Publication No.: US

13 Al, published on September 13, 2007 discloses a Multi-dimensional locating 14 system and method (title). The patent application discloses ways for managing and displaying vectors of documents and other computer-readable files. A
16 vector of documents groups a plurality of documents along a predetermined 17 order, inter alia, is taught.
18 [04] United States Patent Application Publication No.: US

19 Al, published on November 22, 2007 discloses a Multi-dimensional locating system and method (title). A plurality of vectors of documents sharing a 21 common timeline is disclosed.
22 [05] Under some circumstances it is useful to display documents along a 23 timeline although it can prevent an efficient use of the display area when, for 24 example, no documents are located on the timeline over a significant period of time.
26 [06] More than one vector of documents are displayable wherein each 27 vector of documents can group documents having a specific attribute in 28 common. Thus the number of documents chronologically disposed on each 29 vector of documents can vary and a timescale commonly shared by the vectors of documents does not maximize the use of the display area.

1 [07] Using the same timescale for a plurality of vectors of documents with 2 a different number of documents on each vector for the same period of time 3 does not allow an efficient simultaneous display of the vectors of documents. If 4 the timescale is based on a vector of documents having many documents, another vector of documents that has very little documents will almost be 6 empty. Conversely, if the timescale is based on the vector of documents 7 having very little documents, the other vector will be so crowded with 8 documents that it will hardly be possible to usefully glance through the 9 documents. The documents being not enough evenly distributed on both vectors of documents it becomes difficult to appreciate documents displayed on 11 different vectors of documents at the same time with the same timescale.
12 [08] Another issue arise when one vector of documents is more 13 insightfully displaying its documents according to a linear timeline to show, for 14 example, the distribution of the documents on the vector and another vector of documents displays that documents according to a non-linear timeline (i.e.
16 because there is no added value to show the distribution of the documents 17 along the timeline). A common timeline can therefore hardly be used for both 18 arrays of documents.

SUMMARY OF THE INVENTION
21 [09] The following presents a simplified summary of the invention in order 22 to provide a basic understanding of some aspects of the invention. This 23 summary is not an extensive overview of the invention. It is not intended to 24 identify key/critical elements of the invention or to delineate the scope of the invention. Its sole purpose is to present some concepts of the invention in a 26 simplified form as a prelude to the more detailed description that is presented 27 later.
28 [10] It is one aspect of the present invention to provide more than one 29 timeline along which arrays of documents/computer-readable files/multimedia assets are displayed.

1 [11] Another aspect of the present invention provides an interface 2 adapted to display arrays of documents chronologically displaying documents 3 along timelines using different timescales.
4 [12] One other aspect of the present invention provides an interface adapted to display documents along a timeline using a linear timescale, where 6 the documents are not evenly displayed along the timeline representing time in 7 a linear fashion, and documents along a timeline using a non-linear timescale, 8 presenting documents with a substantially constant interval therebetween.
9 [13] One other aspect of the invention provides a combined view where a plurality of arrays of documents displaying documents along a timeline using a 11 linear timescale are displayed with a plurality of arrays of documents 12 displaying documents along a timeline using a non-linear timescale.
13 [14] Another aspect of the invention provides separate display areas (or 14 time space) respectively displaying arrays of documents about distinct timelines in each display area. The timelines can use a non-linear or a linear 16 timescale.
17 [15] An aspect of the present invention provides a plurality of arrays of 18 documents displayed along their respective timelines and adapted to move 19 independently along their respective timeline.
[16] One other aspect of the present invention provides a display with 21 multiple time-spaces, each time-space displaying a timeline with its own 22 timescale.
23 [17] One aspect of the present invention provides a display with multiple 24 time-spaces, each time-space displaying a timeline using either a linear timescale or a non-linear timescale.
26 [18] Another aspect of the present invention provides a function to 27 change the timescale of an array of documents between a linear timescale and 28 a non-linear timescale.
29 [19] An aspect of the present invention provides a first time-space on a first display and a second time-space on a second display.

1 [20] One aspect of the present invention provides time marks that are 2 shared between a plurality of arrays of documents using a compatible 3 timescale.
4 [21] Another aspect of the present invention provides a computerized system adapted to read computer executable instructions adapted to enable a 6 program element enabling an interface adapted to display arrays of 7 documents, the computerized system comprising a processing unit adapted to 8 process the computer executable instructions, a display adapted to display the 9 interface; and the program element, when executed, being operative for causing an array of computer-readable files to be displayed, the array of 11 computer readable files being displayed along a timeline according to a first 12 timescale; and causing an array of computer readable files to be displayed, the 13 array of computer readable files being displayed along a timeline according to 14 a second timescale.
[22] One other aspect of the present invention provides a computer 16 interface comprising a first array of documents to be displayed, said first array 17 of documents being displayed along a timeline according to a first timescale;a 18 second array of documents to be displayed, said second array of documents 19 being displayed along a timeline according to a second timescale.
[23] An aspect of the present invention provides a computer-readable 21 medium including computer-executable instructions providing a method of 22 displaying arrays of computer-readable files, the method comprising causing a 23 first array of computer-readable files to be displayed, said first array of 24 computer-readable files being displayed along a timeline according to a first timescale; causing a second array of computer-readable files to be displayed, 26 said second array of computer-readable files being displayed along a timeline 27 according to a second timescale.
28 [24] These and other advantages and features of the present invention 29 will become apparent from the following description and the attached drawings.

2 Figure 1 is a schematic view of a computer system;
3 Figure 2 is a flow chart of one exemplary process that can be used to create a 4 new array of documents;
Figure 3 is a schematic view of an illustrative display portion of a graphical 6 user interface displaying a plurality of arrays of documents along a linear 7 timeline;
8 Figure 4 is the schematic view of Figure 3 with additional intersecting arrays of 9 documents;
Figure 5 is the schematic view of Figure 3 with invisible units of time;
11 Figure 6 is the schematic view of Figure 3 with non-aligned time marks;
12 Figure 7 is the schematic view of Figure 3 with non-aligned time marks and 13 invisible units of time;
14 Figure 8 is a schematic view of an illustrative graphical user interface displaying a plurality of arrays of documents along a non-linear timeline;
16 Figure 9 is the schematic view of Figure 8 with units of time about to become 17 invisible;
18 Figure 10 is a schematic view of an illustrative graphical user interface 19 displaying a plurality of arrays of documents along a non-linear timeline;
Figure 11 is the schematic view of Figure 10 with some invisible units of time;
21 Figure 12 is a schematic view of an illustrative graphical user interface 22 displaying a plurality of arrays of documents along a non-linear timeline; and 23 Figure 13 is a schematic view of a plurality of arrays of documents along either 24 a non-linear timeline or a linear timeline.
26 DESCRIPTION OF EMBODIMENT(S) OF THE INVENTION
27 [25] The present invention is now described with reference to the 28 drawings, wherein like reference numerals are used to refer to like elements 29 throughout. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough 31 understanding of the present invention. It may be evident, however, that the

5 1 present invention may be practiced without these specific details. In other 2 instances, well-known structures and devices are shown in block diagram form 3 in order to facilitate describing the present invention.
4 [26] The features provided in this specification mainly relates to computer software and machine-readable code/instructions. This code/instructions are

6 preferably stored on a machine-readable medium to be read and acted upon to

7 with a computer or a machine having the appropriate code/instructions reading

8 capability.

9 [27] Figure 1 and the following discussion provide a brief, general description of an exemplary apparatus in which at least some aspects of the 11 present invention may be implemented. The present invention will be 12 described in the general context of computer-executable instructions, such as 13 program modules, being executed by a personal computer. However, the 14 methods of the present invention may be affected by other apparatus.
Program modules may include routines, programs, objects, components, data 16 structures, etc. that perform a task(s) or implement particular abstract data 17 types. Moreover, those skilled in the art will appreciate that at least some 18 aspects of the present invention may be practiced with other configurations, 19 including hand-held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network computers, minicomputers, set 21 top boxes, mainframe computers, portable phones and the like. At least some 22 aspects of the present invention may also be practiced in distributed 23 computing environments where tasks are performed by remote processing 24 devices linked through a communications network (i.e. client-server, Internet based application,...). In a distributed computing environment, program 26 modules may be located in local and/or remote memory storage devices.
27 [28] With reference to Figure 1, an exemplary apparatus 100 for 28 implementing at least some aspects of the present invention includes a general 29 purpose computing device in the form of a conventional personal computer 120. The personal computer 120 may include a processing unit 121, a system 31 memory 122, and a system bus 123 that couples various system components, 1 including the system memory 122, to the processing unit 121. The system bus 2 123 may be any of several types of bus structures including a memory bus or 3 memory controller, a peripheral bus, and a local bus using any of a variety of 4 bus architectures. The system memory may include read only memory (ROM) 124 and/or random access memory (RAM) 125. A basic input/output system 6 126 (BIOS), containing basic routines that help to transfer information 7 between elements within the personal computer 120, such as during start-up, 8 may be stored in ROM 124. The personal computer 120 may also include a 9 hard disk drive 127 for reading from and writing to a hard disk, (not shown), a magnetic disk drive 128 for reading from or writing to a (e.g., removable) 11 magnetic disk 129, and an optical disk drive 130 for reading from or writing to 12 a removable (magneto) optical disk 131 such as a compact disk or other 13 (magneto) optical media. The hard disk drive 127, magnetic disk drive 128, 14 and (magneto) optical disk drive 130 may be coupled with the system bus by a hard disk drive interface 132, a magnetic disk drive interface 133, and a 16 (magneto) optical drive interface 134, respectively. The drives and their 17 associated storage media provide nonvolatile (or persistent) storage of 18 machine readable instructions, data structures, program modules and other 19 data for the personal computer 120. Although the exemplary environment described herein employs a hard disk, a removable magnetic disk 129 and a 21 removable optical disk 131, those skilled in the art will appreciate that other 22 types of storage media, such as magnetic cassettes, flash memory cards, 23 digital video disks, Bernoulli cartridges, random access memories (RAMs), read 24 only memories (ROM), and the like, may be used instead of, or in addition to, the storage devices introduced above.
26 [29] A number of program modules may be stored on the hard disk 127, 27 magnetic disk 129, (magneto) optical disk 131, ROM 124 or RAM 125, such as 28 an operating system 135 (for example, Windows NT® 4.0, sold by 29 Microsoft Corporation of Redmond, Wash.), one or more application programs 136, other program modules 137 (such as "Alice", which is a 31 research system developed by the User Interface Group at Carnegie Mellon =

1 University available at www.Alice.org, OpenGL from Silicon Graphics Inc.
of 2 .. Mountain View Calif., or Direct 3D from Microsoft Corp. of Bellevue Wash.), 3 and/or program data 138 for example.
4 [30] A user may enter commands and information into the personal .. computer 120 through input devices, such as a keyboard 140, a camera 141 6 .. and pointing device 142 for example. Other input devices (not shown) such as 7 a microphone, joystick, game pad, satellite dish, scanner, a touch sensitive 8 .. screen, or the like may also be included. These and other input devices are 9 often connected to the processing unit 121 through a serial port interface 146 coupled to the system bus. However, input devices may be connected by other 11 interfaces, such as a parallel port, a game port or a universal serial bus (USB).
12 .. For example, since the bandwidth of the camera 141 may be too great for the 13 serial port, the video camera 141 may be coupled with the system bus 123 via 14 a video capture card (not shown). The video monitor 147 or other type of display device may also be connected to the system bus 123 via an interface, 16 such as a video adapter 148 for example. The video adapter 148 may include a 17 .. graphics accelerator. One or more speaker 162 may be connected to the 18 system bus 123 via a sound card 161 (e.g., a wave table synthesizer such as 19 .. product number AWE64 Gold Card from Creative Labs of Milpitas, Calif.).
In addition to the monitor 147 and speaker(s) 162, the personal computer 120 21 may include other peripheral output devices (not shown), such as a printer for 22 example. As an alternative or an addition to the video monitor 147, a stereo 23 video output device, such as a head mounted display or LCD shutter glasses 24 for example, could be used.
[31] The personal computer 120 may operate in a networked environment 26 which defines logical connections to one or more remote computers, such as a 27 remote computer 149. The remote computer 149 may be another personal 28 computer, a server, a router, a network PC, a peer device or other common 29 network node, and may include many or all of the elements described above relative to the personal computer 120, although only a memory storage device 31 has been illustrated in Figure 1. The logical connections depicted in Figure 1 1 include a local area network (LAN) 151 and a wide area network (WAN) 152, 2 an Intranet and the Internet.
3 [32] When used in a LAN, the personal computer 120 may be connected 4 to the LAN 151 through a network interface adapter (or "NIC") 153. When used in a WAN, such as the Internet, the personal computer 120 may include a 6 modem 154 or other means for establishing communications over the wide 7 area network 152 (e.g. Wi-Fi, WinMax). The modem 154, which may be 8 internal or external, may be connected to the system bus 123 via the serial 9 port interface 146. In a networked environment, at least some of the program modules depicted relative to the personal computer 120 may be stored in the 11 remote memory storage device. The network connections shown are 12 exemplary and other means of establishing a communications link between the 13 computers may be used.
14 [33] Figure 2 is a flow chart of one exemplary way to create an array of documents (or an array of computer-readable files or an array of multimedia 16 assets). A user of the computer interface desires to create a new array of 17 documents 172. The user decides what timescale will use the timeline of the 18 new array of documents 176. If a linear timescale is selected the documents 19 will be disposed on the new array of documents along a timeline using a linear timescale 178. Conversely, if a non-linear timescale is selected the documents 21 will be disposed on the new array of documents along a timeline using a non-22 linear timescale 174. Continuing with the new array of documents using a non-23 linear timescale 174 the user can decide whether isolated movement of the 24 new array of documents along its timeline will be allowed 182. The location of the new array of documents on the display is then selected 186 and the new 26 array of documents is displayed on the display 190.
27 [34] Returning back to the new array of documents using the linear 28 timescale 178. Once the type of timescale is decided the user decides if s/he 29 wants to associate the linear timescale of the new array of documents with an already existing array of documents using a linear timescale 180. If no 31 association with another array of documents is made then the process follows 1 the route explained above at box 182. In contrast, if the linear timescale of the 2 new array of documents is associated with another array of documents, the 3 another array of documents is then selected among other arrays of documents 4 184. The array of documents to be selected can already be associated with a number of other arrays of documents thus all sharing the same linear 6 timescale. Once the other array of documents is selected then the location of 7 the display of the new array of document is decided 188. It can be made by a 8 simple selection on the display but preferably next to the array of documents 9 with which the timescale is shared so that the time marks can be commonly shared. The new array of documents is then displayed 192. This ends 194 one 11 exemplary way to create a new array of documents taking into consideration 12 the type of timescale to be used in addition to several other related decisions.
13 [35] Now that a general process has been explained we will move to a 14 more detailed explanation of its constituting parts.
[36] In the context of the present invention the following terms are 16 generally used with their associated meaning.
17 [37] Document: A piece of information. Generally a computer file usually 18 created with an application (such as a word processor) carrying textual, audio, 19 video or graphical information.
[38] Timeline: A chronological order adapted to position documents 21 according to a time-related parameter.
22 [39] Timescale: The time distribution along the timeline.
23 [40] Linear timescale: Substantially constant time distribution.
24 [41] Non-linear timescale: Substantially variable time distribution.
[42] Array: A regular and imposing grouping or arrangement of 26 documents/files/assets. Generally an array of documents will dispose 27 documents along a substantially rectilinear fashion although other dispositions 28 (such as inter alia multiple rectilinear superposition, matrixes, flow charts like 29 disposition, tri-dimensional distribution) are encompassed by the present definition.

1 [43] Combined view: Display of arrays of documents having different 2 timescales.
3 [44] Display: Means for displaying a graphical representation of an array 4 of documents. Commonly referred to, inter alia, a computer screen, a television, a projector, a touch sensitive screen and a means to provide tri-6 dimensional graphical rendering.
7 [45] Time-space: Means for displaying arrays of documents using a 8 similar timescale. The time-space can accommodate a single array of 9 document.
11 [46] Embodiment One - Linear Timescale With Aligned Time Marks 12 Between Arrays of Documents Having Units of Time of Similar Duration 13 [47] Figure 3 illustrates three arrays of documents 200.1, 200.2, 200.3 14 disposed next to one another on a computer interface 8. Each array of documents 200.1, 200.2, 200.3 has a vector-like shape and is bordered with 16 guides 208 to visually emphasis the width and the direction of the each array 17 of documents 200.1, 200.2, 200.3. Each array of documents 200.1, 200.2, 18 200.3 displays a series of documents 10 disposed along a timeline 202.
Each 19 array of documents 200.1, 200.2, 200.3 can group and display a plurality of documents 10 having a commonality. A commonality like an attribute 21 associated with each document or a tag in common so that only a subset of a 22 larger group of documents 10 is displayed. In the present situation the timeline 23 is a chronological timeline where positive time 206 is heading to the right of 24 Figure 3. Each document 10 is disposed along the timeline 202 on its array of documents 200.1, 200.2, 200.3 in accordance with a time-related criteria that 26 can be, inter alia, the time of insertion of the document 10 in the computer 27 system running the interface, the time at which a document was modified last, 28 the time of creation of the document, the last viewed time, the end of a delay, 29 a bar date, the date by which a document should be received in reaction to an action made earlier in time or simply an arbitrary time associated with each 31 document. The user can decide, for instance, that all documents 10 will be 11.

1 displayed along their related timelines using the time of insertion of the 2 documents in the computer system. This way all documents will be disposed 3 on a timeline at the exact time they were inserted in the computer system. For 4 simplification each document can appear during the day of its insertion in the system and not precisely at the exact hour.
6 [48] Still on Figure 3, each array of documents 200.1, 200.2, 200.3 is 7 separated in unit of time. In this case the units of time are days D1, D2, D3, 8 D4. Each unit of time D1, D2, D3, D4 is separated with a time mark 204.
For 9 example, day 1 (D1), day 2 (D2), day 3 (D3), day 4 (D4) and day 5 (D5) all have the same length 212 and are each respectively separated by a time mark 11 204. In this case, the illustrative example is using a "day" as time unit but it 12 could be minutes, hours, weeks, months, years, fiscal year, a project 13 milestones or any other custom duration of time. Each unit of time D1, D2, D3, 14 D4 on Figure 3 is represented with a constant time length 212. The first document 10.1 on the array of documents 200.1 was, for example, inserted in 16 the computer system on the second half of the day represented by unit of time 17 Dl. No document was inserted on D2 and so on so forth.
18 [49] The timescale of all arrays of documents depicted on Figure 3 is a 19 linear timescale. This means that the duration of each unit of time D1, D2, D3, D4 is represented having the same length 212. The constant time length 212 21 provides the possibility of aligning 214 each time mark 204 to unify the 22 timescale of all arrays of documents 200.1, 200.2, 200.3, 200.4.
23 [50] Still referring to Figure 3, the distance between each array of 24 documents 200.1, 200.2, 200.3 can be the same of it can vary depending on what is desired by the user of the computer interface 8. Each document 10 is 26 represented with a rectangle 12 but other shapes are encompassed by the 27 present invention. The rectangular shape 12 is used because it infers more 28 easily with a sheet of paper In the present illustrative example. Each document 29 10 is either displaying the document itself, a thumbnail of the document or an icon depending on the purpose of the view, the level of the zoom and/or the 31 desired amount of details to be shown. A picture taken in landscape would 1 have a different shape and the present invention does not intend to be limited 2 to the illustrative shapes displayed in the Figures.
3 [51] In the following Figures all documents 10, time marks 204 and time 4 length 212 might not be individually associated with a related reference number to avoid unusefully overloading the Figures. The Applicant assumes 6 that people skilled in the art of computer interface will not be confused with 7 the omitted reference numbers on the Figures when considered in light of the 8 description and will be resourceful enough to refer to a Figure where the 9 reference number is indicated or relevant passage from the description in case of need.
11 [52] Turning back now to Figure 4 illustrating the same three arrays of 12 documents 200.1, 200.2, 200.3 from Figure 3. Two additional arrays of 13 documents 200.4, 200.5 have been added non-parallel to the three first arrays 14 of documents 200.1, 200.2, 200.3. Array 200.4 is logically intersecting array 200.2, based on intersecting document 20. Array 200.4 also shows time marks 16 204 and constant time lengths 212. Similarly, intersecting array 200.5 is 17 logically intersecting array 200.1, based on intersecting document 20.
Array 18 200.5 also shows time marks 204 and variable time lengths 222 that will be 19 discussed below. The role of intersecting arrays 200.4, 200.5 is explained in details in a previous patent application referenced by the instant patent 21 application and will not be discussed here in details.
22 [53] The array of documents 200.1 illustrated on Figures 3 and Figures 4 23 has a unit of time D2 containing no documents. Depending on the situation it 24 might be helpful to see the distribution of the documents 10 depicted along the timeline 202 of array 200.1 with the empty units of time. However, it is also a 26 loss of space on the display if the distribution of the documents 10 on the 27 array and the showing of a unit of time D2 showing no documents 10 are not 28 insightful. Removal of specific units of time or empty units of time can be 29 desirable. For example, a unit of time D4 might not contain documents 10 that are desirable to see and this unit of time D4 might be removed from the 31 display. The removal of units of time can be made manually by a user of 1 automatically if, for instance, there is no documents in a time unit or if only 2 documents having a specified attribute are present.
3 [54] An alternate view of Figure 3 hiding unit of time D4 is illustrated on 4 Figure 5. The unit of time D4 is hidden and the time marks 204 juxtaposed to the unit of time D4 have been moved close one to each other to form a 6 distinctive visual time mark 30 that is called invisible unit of time time mark 7 30. The selection of invisible unit of time mark 30 by the user of the interface 8 can provide information about the invisible time period and the possibility of 9 display it if desired. A selection of one or many unit(s) of time D can offer the possibility to render invisible this portion of the timeline.

12 [55] Embodiment Two ¨ Linear Timescale With Non-Aligned Time 13 Marks Between Arrays of Documents Having Units of Time of Similar 14 Duration [56] Figures 6 illustrates the three arrays of documents 200.1, 200.2, 16 200.3 of Figure 3 with the difference that the time marks 204 are not aligned 17 anymore as indicated by dotted arrow 230. Despite the three arrays of 18 documents 200.1, 200.2, 200.3 sharing a similar linear timescale they cannot 19 share the same timemarks 204.
[57] Array of document 200.2 has been individually translated in the 21 positive 206 direction of the timeline 202 as indicated by arrow 234 while the 22 first array of documents 200.1 remained in the same position. The third array 23 of documents 200.3 has slightly been individually translated in the negative 24 direction of the timeline 202 as indicated by arrow 236.
[58] The translation along the timeline of an array of documents 200.2, 26 200.3 allows a user to visualize a different unit of time on the array of 27 documents. For example, array of documents 200.1 displays units of time D1, 28 D2, D3, D4 while units of time D18, D19, D20, D21 are displayed for the 29 second array of documents 200.2. The third array of documents 200.3 is still displaying the same units of time D1, D2, D3, D4 as the first array of 1 documents 200.1 although a slight translation has began and unit of time D5 is 2 now partially visible anymore.
3 [59] The translation of an array of document can be made with an 4 appropriate control in communication with the computer system to manage the arrays of documents on the interface. For instance, the arrow keys on the 6 keyboard, a mouse, a pointing device, fingers on a tactile screen, a gamepad 7 or any other means to influence the position of the arrays on the display is 8 encompassed by the present invention. In the present example a point-click-9 hold-and-move set of actions with a pointing device has positioned the arrays of documents.
11 [60] Referring to Figure 7 one can appreciate that, as indicated by arrow 12 238, unit of time D4 from array of documents 200.1 has been hidden in favor 13 of adjacent units of time D3, D5 containing documents. Several units of time 14 (e.g. D20 to D25 and D27) have been hidden from array of documents 200.2 as indicated by invisible unit of time timemarks 240, 242. On array of 16 documents 200.3, units of time D3, D4 are in the process of being hidden to 17 benefit units of time D2, D5. Invisible unit of time timemarks 244, 246 are 18 already displayed on array of documents 200.3 and a length 248 will not be 19 visible anymore until the interface is instructed to render this length visible again. Units of time including documents can be hidden if required by 21 the user based on some criterions like a selected attribute.

23 [61] Embodiment Three ¨ Linear Timescale With Non-Aligned Time 24 Marks Between Arrays of Documents Having Units of Time of Dissimilar Durations 26 [62] Figure 7 illustrates three arrays of documents 200.1, 200.2, 200.3 27 having a linear timescale. The linear tinnescale of each array of documents is 28 however different as opposed to the previous illustrative example depicted on 29 Figure 6. On Figure 8, the first array 200.1 uses unit of time 212.1 having a duration of time that is longer than the duration of the unit of time 212.2 of 31 array 200.3. The duration of the unit of time 212.3 of array 200.3 is longer 1 than the duration of time of unit of time 212.2 but shorter than the duration of 2 unit of time 212.1. A different number of unit of time 212 can be shown on the 3 same display width.
4 [63] Since arrays 200.1, 200.2, 200.3 are not using the same duration of unit of time they cannot share the same time marks 204. The duration of the 6 unit of time of each array of documents can be selected individually to provide 7 the view that is the most suited for the user. If for instance array 200.1 is 8 displaying documents 10 that are more important than the documents 9 displayed by array 200.2, then, the duration of the unit of time 212.1 can be set to be longer than the duration of the unit of time 212.2. Because the 11 durations of time of each array of documents is distinct the time marks cannot 12 be used collectively.
13 [64] Referring now to Figure 9 one can appreciate the same arrays of 14 documents as the ones displayed on Figure 8 although lengths of time 248 from array 200.2 are about to be rendered invisible. The principle has been 16 explained before and it will not be re-explained here. The same mechanism is 17 simply applied in this embodiment.

19 [65] Embodiment Four ¨ Arrays of Documents Using Non-Linear Timescales 21 [66] Turning now to Figure 10 displaying three new arrays of documents 22 200.6, 200.7, 200.8. Each of these arrays of documents 200.6, 200.7, 200.8 23 are displaying documents 10 along their respective timelines 202 using a non-24 linear timescale. The non-linear time line is giving up the linearity of time in favor of an even documents distribution using more efficiently the space 26 available on the array of documents. The use of a non-linear timescale 27 disposes each document 10 at a substantially constant interval. For instance, 28 array of documents 200.6 display a portion of its first time unit D1 having a 29 length 222.1 corresponding to the length needed to display all documents

10 that need to be displayed in time unit Dl. The second time unit D2 on array of 31 documents 200.6 displays six documents 10 along the timeline 202 and the 1 length 222.2 is the length needed to evenly distribute and display the six 2 documents 10. The same for the third time unit D3 with its four documents.
3 Each time unit D1, D2, D3 is separated with a time mark 204 from the other 4 adjacent time unit.
[67] Still on Figure 10, array of documents 200.7 displays time units 6 D156, D157, D158, D159, D160, D161, D162. Each time unit D156-D162 7 contains a number of documents 10 and the length of each time unit 222.4, 8 222.5, 222.6, 222.7, 222.8, 222.9, 222.10 is proportional to the length needed 9 to equally distribute the number of documents belonging to each unit of time.
The same logic applies to array of documents 200.8 with units of time D88-

11 D92 and timeline lengths 222.11-222.15.

12 [68] Each array of documents 200.6, 200.7, 200.8 can be displaced along

13 the timeline 202 like it is respectively indicated by arrows 250, 252, 254. This

14 explains why different time periods are visible on each array despite they appear one over the other. The time marks 204 are not aligned across the 16 three arrays of documents because the length of each time unit D* is not 17 standardized (e.g. non-linear timescale) in contrast to the standardized length 18 of units of time used by a linear timescale as previously described.
19 [69] The non-linear timescale 220 does save space on the display because there are no empty spaces left out as opposed to the use of a linear timescale 21 210 always using the same length for each unit of time.
22 [70] Referring now to Figure 11 one can appreciate the removal of 23 particular time units. Time units D162 is now invisible and invisible unit of time 24 time mark 30 identifies the location of the invisible time units. Array of documents 200.8 has two invisible unit of time time marks 30 because units of 26 time D91-D94 and D96 are invisible. The same principle of invisibility is applied 27 here on arrays of documents 200.6, 200.7, 2008 using a non-linear timescale 28 220.

[71] Embodiment Five ¨ Arrays of Documents Using Non-Linear 31 Timescales and Aligned Time Marks 1 [72] Figure 12 illustrates another embodiment where the three arrays of 2 documents 200.9, 200.10, 200.11 are using a shard non-linear timescale to 3 display the documents along their timelines 202. On Figure 12 however, 4 despite a non-linear timescale is used, the time marks 204 are aligned across all arrays of documents 200.9, 200.10, 200.11. This is possible by grouping 6 the three arrays of documents 200.9, 200.10, 200.11 and defining the length 7 of each unit of time D* by using the longer length 222 needed across all the 8 arrays of documents 200.9, 200.10, 200.11. In the illustrative example 9 depicted by Figure 12 unit of time D2 uses the length 222.22 based on the length needed to fit the five documents 10 on array 200.9. Unit of time D3 11 uses the length 222.23 based on the length needed to fit the two documents 12 10 on array 200.10, unit of time D4 uses the length 222.24 based on the 13 length needed to fit a single document 10 on array 200.9 and unit of time D5 14 uses the length 222.25 based on the length needed to fit the three documents 10 on array 200.11. Unit of time D6 have the length of a single document 10 16 to accommodate one document located in two arrays 200.9, 200.11.
17 [73] This type of presentation allows grouping and aligning the time 18 marks 204 of a plurality of arrays of documents using a non-linear timescale 19 220. The save in display space is not as good as the previous embodiment however it might be more easy to see the same time period 222 on several 21 arrays of documents 200 at once. The movement 250, 252, 254 along the 22 timeline 202 of the arrays of documents 200.9, 200.10, 200.11 are preferably 23 connected 256 so that all arrays are moving together to keep the time marks 24 204.
26 [74] Embodiment Six ¨ Combined View of Arrays of Documents 27 Using Non-Linear and Non-Linear Timescales 28 [75] Figure 13 illustrates a view of the interface presenting a plurality of 29 arrays of documents 200.6, 200.7, 200.8, 200.12, 200.1, 200.2, 200.3.
Arrays of documents 200.6, 200.7, 200.8 are using a non-linear timescale to display 31 the documents along their time line 202. Conversely, arrays of documents 1 200.12, 200.1, 200.2, 200.3 are using a linear timescale to display the 2 documents along their timeline 202.
3 [76] Documents on the arrays of documents 200.6, 200.7 are smaller 4 than the documents on arrays of documents 200.12, for instance, because it was desired to show more documents 10 on these arrays of documents despite 6 the documents 10 are smaller. Arrays of documents 200.6 also illustrates a cut 7 in the timeline 202 illustrated by the invisible unit of time time mark 30 where 8 a unit of time 222 is invisible.
9 [77] The time marks 204 on arrays of documents 200.6, 200,7, 200.8 are not aligned because, as explained earlier, they are not sharing the same linear 11 timescale thus they have different unit of time 222 lengths.
12 [78] Turning now to arrays of documents 200.12, 200.1, 200.2, 200.3 13 using a linear timescale. The units of time length 212.1 of the array 200.12 are 14 longer than the unit of time length 212.3 used by the arrays 200.1, 200.2, 200.3 therefore less units of time will be displayed on the same display for 16 array 200.12 and the time marks 204 cannot be aligned 262 or shared.
17 However, arrays of documents 200.1, 200.2, 200.3 are using a common linear 18 timescale 210 and can therefore share time marks 204 between them. The 19 arrays can also be moved 250, 252, 254, 258, 260, individually, in groups or collectively 260, along the timeline 202. Arrays of documents 200.1, 200.2, 21 200.3 also illustrate a cut in the timeline 202 illustrated by the invisible unit of 22 time time mark 30 where one or many units of time 212.3 are invisible in 23 accordance with the desire of an hypothetical user.
24 [79] All the arrays of documents illustrated on Figure 13 can be reordered (i.e. vertically) to meet one's preferences. Spaces can be left between two 26 arrays although they are all presented sharing no space therebetween on the 27 illustrative Figure 13.
28 [80] All the arrays of documents can be displayed on the same 29 "combined" time-space. Although, It might be desirable to separate each arrays of documents using a distinct timescale, for ease of use of the interface 31 or for programming purpose, to group arrays of documents either using similar 1 linear timescale or non-linear timescale. This grouping can also be made on the 2 basis of the timescale used to distribute the documents 10 on the arrays of 3 documents. Each group of arrays of documents will define a time-space 4 because they all commonly share either the linearity of the timeline or they share the same unit of time length and can therefore share the time marks 6 204. This also allows a user to change the strength of the zoom (zoom-in /
7 zoom-out) on only one time-space at the time, change the size of the 8 documents, navigate through time 202 on a single time-space while the other 9 time-spaces (or a single array of documents defining its own time-space) are kept still.
11 [81] The use of various time-space can be made on a single display or on 12 a plurality of displays. For example, each display could present a single time-13 space and navigate the arrays of documents more consistently. In the case 14 where more than one time-space is displayed on a single display then they can appear with a gap therebetween, in different windows or simply using alternate 16 views where each view display one time-space at the time and the switch 17 between the views is made by actuating an icon or a predetermined set of keys 18 on a keyboard.
19 [82] The description and the drawings that are presented above are meant to be illustrative of the present invention the scope of which is defined 21 by the following claims:

Claims

1 What is claimed is:

3 1. A method of presenting axes of documents along timelines on a display, the method 4 comprising:
providing a plurality of documents;
6 selecting a first subset of documents from the plurality of documents on a basis of a 7 first attribute;
8 on a basis of the selection of the first subset of documents, displaying the first subset 9 of documents with a first time-space on a display, the documents of the first subset being displayed along a first axis of documents adjacently displaying documents in a rectilinear 11 fashion on the display along a chronological order including a first timeline, the first axis 12 locating the documents displayed thereon along the chronological order over a plurality of 13 time units;
14 selecting a second subset of documents from the plurality of documents on a basis of a second attribute;
16 on a basis of the selection of the second subset of documents, displaying the second 17 subset of documents with a second time-space on the display, the documents of the second 18 subset being displayed along a second axis of documents adjacently displaying documents 19 in a rectilinear fashion on the display along the chronological order including a second timeline, the second axis locating the documents displayed thereon along the chronological 21 order over a plurality of time units including a non-linear timescale and a time distribution 22 that is substantially variable, with equal lengths of time not being visually represented with 23 equal lengths of distance along the second axis of documents;
24 selecting a third subset of documents from the plurality of documents on a basis of a third attribute; and 26 on a basis of the selection of the third subset of documents, displaying the third 27 subset of documents with a third time-space on the display, the documents of the third 28 subset being displayed along a third axis of documents adjacently displaying documents in 29 a rectilinear fashion on the display along the chronological order including a third timeline, the third axis locating the documents displayed thereon along the chronological order over 31 a plurality of time units including a non-linear timescale and a time distribution that is 32 substantially variable, with equal lengths of time not being visually represented with equal 33 lengths of distance along the third axis of documents, wherein the units of time of the third Date Recue/Date Received 2020-06-15 1 time-space are chronologically shorter than the units of time of the second time-space and 2 the units of time of the second time-space are chronologically shorter than the units of time 3 of the first time-space and at least one unit of time is absent from the second timeline of the 4 second axis of documents and at least one unit of time is absent from the third timeline of the third axis of documents.

7 2. The method of claim 1, wherein the units of time of the first time-space are 8 respectively representing a year time period, the units of time of the second time-space are 9 respectively representing a month time period and the units of time of the third time-space are respectively representing a day time period.

12 3. The method of any one of claims 1 and 2, wherein the first time-space includes a 13 non-linear timescale and a time distribution that is substantially variable, with equal lengths 14 of time not being visually represented with equal lengths of distance along the first axis of documents.

17 4. The method of any one of claims 1 to 3, further comprising a fourth subset of 18 information elements displayed on an axis that is orthogonally located in respect of the third 19 axis.
21 5. The method of any one of claims 1 to 4, wherein at least some of the documents are 22 pictures.

24 6. The method of any one of claims 1 to 5, wherein the first axis, the second axis and the third axis are displayed vertically on the display.

27 7. The method of any one of claims 1 to 6, wherein the documents are displayed with 28 a plurality of sizes along one of the axes.

8. A non-transitory computer-readable medium having stored thereon computer-31 readable instructions that, when executed by a computer, cause the computer to perform 32 operations for displaying axes of documents on a display, the operations comprising:
33 providing a plurality of documents;

Date Recue/Date Received 2020-06-15 1 selecting a first subset of documents from the plurality of documents on a basis of a 2 first attribute;
3 displaying the first subset of documents with a first time-space on a display, the 4 documents of the first subset being displayed along a first axis of documents adjacently displaying documents in a rectilinear fashion on the display along a chronological order 6 including a first timeline, the first axis locating the documents displayed thereon along the 7 chronological order over a plurality of time units;
8 selecting a second subset of documents from the plurality of documents on a basis of a 9 second attribute;
displaying the second subset of documents with a second time-space on the display, 11 the documents of the second subset being displayed along a second axis of documents 12 adjacently displaying documents in a rectilinear fashion on the display along the 13 chronological order including a second timeline, the second axis locating the documents 14 displayed thereon along the chronological order over a plurality of time units including a non-linear timescale and a time distribution that is substantially variable, with equal lengths of 16 time not being visually represented with equal lengths of distance along the second axis of 17 documents;
18 selecting a third subset of documents from the plurality of documents on a basis of 19 a third attribute; and displaying the third subset of documents with a third time-space on the display, the 21 documents of the third subset being displayed along a third axis of documents adjacently 22 displaying documents in a rectilinear fashion on the display along the chronological order 23 including a third timeline, the third axis locating the documents displayed thereon along the 24 chronological order over a plurality of time units including a non-linear timescale and a time distribution that is substantially variable, with equal lengths of time not being visually 26 represented with equal lengths of distance along the third axis of documents, wherein the 27 units of time of the third time-space are chronologically shorter than the units of time of the 28 second time-space and the units of time of the second time-space are chronologically 29 shorter than the units of time of the first time-space and at least one unit of time is absent from the second timeline of the second axis of documents and at least one unit of time is 31 absent from the third timeline of the third axis of documents.

Date Recue/Date Received 2020-06-15 1 9. The non-transitory computer-readable medium of claim 8, wherein the units of time 2 of the first time-space are respectively representing a year time period, the units of time of 3 the second time-space are respectively representing a month time period and the units of 4 time of the third time-space are respectively representing a day time period.
6 10. The non-transitory computer-readable medium of any one of claims 8 and 9, wherein 7 the first time-space includes a non-linear timescale and a time distribution that is 8 substantially variable, with equal lengths of time not being visually represented with equal 9 lengths of distance along the first axis of documents.
11 11. The non-transitory computer-readable medium of any one of claims 8 to 10, further 12 comprising a fourth subset of information elements displayed on an axis that is orthogonally 13 located in respect of the third axis.

12. The non-transitory computer-readable medium of any one of claims 8 to 11, wherein 16 at least some of the documents are pictures.

18 13. The non-transitory computer-readable medium of any one of claims 8 to 12, wherein 19 the first axis, the second axis and the third axis are displayed vertically on the display.
21 14. The non-transitory computer-readable medium of any one of claims 8 to 13, wherein 22 the documents are displayed with a plurality of sizes along one of the axes.

24 15. A mobile device comprising:
a casing;
26 a CPU supported by the casing;
27 a display adapted to display a user interface configured for 28 providing a plurality of documents;
29 selecting a first subset of documents from the plurality of documents on a basis of a first attribute;
31 displaying the first subset of documents with a first time-space on a 32 display, the documents of the first subset being displayed along a first axis of documents 33 adjacently displaying documents in a rectilinear fashion on the display along a chronological Date Recue/Date Received 2020-06-15 1 order including a first timeline, the first axis locating the documents displayed thereon along 2 the chronological order over a plurality of time units;

selecting a second subset of documents from the plurality of documents 4 on a basis of a second attribute;
displaying the second subset of documents with a second time-space on 6 the display, the documents of the second subset being displayed along a second axis of 7 documents adjacently displaying documents in a rectilinear fashion on the display along the 8 chronological order including a second timeline, the second axis locating the documents 9 displayed thereon along the chronological order over a plurality of time units including a non-linear timescale and a time distribution that is substantially variable, with equal lengths of 11 time not being visually represented with equal lengths of distance along the second axis of 12 .. documents;

selecting a third subset of documents from the plurality of documents on 14 a basis of a third attribute; and displaying the third subset of documents with a third time-space on the 16 display, the documents of the third subset being displayed along a third axis of documents 17 adjacently displaying documents in a rectilinear fashion on the display along the 18 chronological order including a third timeline, the third axis locating the documents displayed 19 thereon along the chronological order over a plurality of time units including a non-linear timescale and a time distribution that is substantially variable, with equal lengths of time not 21 being visually represented with equal lengths of distance along the third axis of documents, 22 wherein the units of time of the third time-space are chronologically shorter than the units of 23 time of the second time-space and the units of time of the second time-space are 24 chronologically shorter than the units of time of the first time-space and at least one unit of time is absent from the second timeline of the second axis of documents and at least one 26 unit of time is absent from the third timeline of the third axis of documents.

28 16.
The mobile device of claim 15, wherein the units of time of the first time-space are 29 respectively representing a year time period, the units of time of the second time-space are respectively representing a month time period and the units of time of the third time-space 31 are respectively representing a day time period.

Date Recue/Date Received 2020-06-15 1 17. The mobile device of any one of claims 15 and 16, wherein the first time-space 2 includes a non-linear timescale and a time distribution that is substantially variable, with 3 equal lengths of time not being visually represented with equal lengths of distance along the 4 first axis of documents.
6 18. The mobile device of any one of claims 15 to 17, further comprising a fourth subset 7 of information elements displayed on an axis that is orthogonally located in respect of the 8 third axis.

19. The mobile device of any one of claims 15 to 18, wherein at least some of the 11 documents are pictures.

13 20. The mobile device of any one of claims 15 to 19, wherein the first axis, the second 14 axis and the third axis are displayed vertically on the display.
16 21. A method of displaying axes of images along timelines on a display, the method 17 comprising:
18 displaying, on a display, a first set of images based on a first attribute, the images of 19 the first set being displayed along a first axis of images adjacently displaying images in a rectilinear fashion on the display along a chronological order including a first timeline;
21 displaying, on the display, a second set of images based on a second attribute, the 22 images of the second set being displayed along a second axis of images adjacently 23 displaying images in a rectilinear fashion on the display along the chronological order 24 including a second timeline, the second axis locating the images displayed thereon along the chronological order over a plurality of time units, wherein the second timeline includes a 26 non-linear timescale and a time distribution that is substantially variable, with equal lengths 27 of time being visually represented with unequal lengths of distance along the second axis of 28 images; and 29 displaying, on the display, a third set of images from the plurality of images based on a third attribute, the images of the third set being displayed along a third axis of images 31 adjacently displaying images in a rectilinear fashion on the display along the chronological 32 order including a third timeline, the third axis locating the images displayed thereon along 33 the chronological order over a plurality of time units, wherein the third timeline includes a Date Recue/Date Received 2020-06-15 1 non-linear timescale and a time distribution that is substantially variable, with equal lengths 2 of time being visually represented with unequal lengths of distance along the third axis of 3 .. images, wherein the units of time of the third axis are chronologically shorter than the units 4 of time of the second axis.
6 22. The method of claim 21, wherein units of time of the first axis are years, the units of 7 time of the second axis are months, and the units of time of the third axis are days.

9 23. The method of any one of claims 21 and 22, wherein the first axis includes a linear timescale and a time distribution that is substantially invariable, with equal lengths of time 11 being visually represented with substantial equal lengths of distance along the first axis of 12 images.

14 24. The method of any one of claims 21 to 23, further comprising a fourth set of images displayable in an axis that is orthogonally located with respect to the first axis.

17 25. The method of any one of claims 21 to 24, wherein at least some of the images are 18 pictures.

26. The method of any one of claims 21 to 25, wherein the first axis, the second axis and 21 the third axis are displayable vertically on the display.

23 27. The method of any one of claims 21 to 26, wherein at least one of the axes is adapted 24 to switch between a linear timescale and the non-linear timescale.
26 28. A non-transitory computer-readable medium having stored thereon computer-27 readable instructions that, when executed by a computer, cause the computer to perform 28 operations for displaying axes of images on a display, the operations comprising:
29 displaying, on a display, a first set of images based on a first attribute, the images of the first set being displayed along a first axis of images adjacently displaying images in a 31 rectilinear fashion on the display along a chronological order including a first timeline;
32 displaying, on the display, a second set of images based on a second attribute, the 33 images of the second set being displayed along a second axis of images adjacently Date Recue/Date Received 2020-06-15 1 displaying images in a rectilinear fashion on the display along the chronological order 2 including a second timeline, the second axis locating the images displayed thereon along 3 the chronological order over a plurality of time units, wherein the second timeline includes a 4 non-linear timescale and a time distribution that is substantially variable, with equal lengths of time being visually represented with unequal lengths of distance along the second axis of 6 images; and 7 displaying, on the display, a third set of images from the plurality of images based on 8 a third attribute, the images of the third set being displayed along a third axis of images 9 adjacently displaying images in a rectilinear fashion on the display along the chronological order including a third timeline, the third axis locating the images displayed thereon along 11 the chronological order over a plurality of time units, wherein the third timeline includes a 12 non-linear timescale and a time distribution that is substantially variable, with equal lengths 13 of time being visually represented with unequal lengths of distance along the third axis of 14 images, wherein the units of time of the third axis are chronologically shorter than the units of time of the second axis.

17 29. The non-transitory computer-readable medium of claim 28, wherein units of time of 18 the first axis are years, the units of time of the second axis are months, and the units of time 19 of the third axis are days.
21 30. The non-transitory computer-readable medium of any one of claims 28 and 29, 22 wherein the first axis includes a linear timescale and a time distribution that is substantially 23 invariable, with equal lengths of time being visually represented with substantial equal 24 lengths of distance along the first axis of images.
26 31. The non-transitory computer-readable medium of any one of claims 28 to 30, further 27 comprising a fourth set of images displayable in an axis that is orthogonally located with 28 respect to the first axis.

32. The non-transitory computer-readable medium of any one of claims 28 to 31, wherein 31 at least some of the images are pictures.

Date Recue/Date Received 2020-06-15 1 33. The non-transitory computer-readable medium of any one of claims 28 to 32, wherein 2 the first axis, the second axis and the third axis are displayable vertically on the display.

4 34. The non-transitory computer-readable medium of any one of claims 28 to 33, wherein at least'one of the axes is adapted to switch between a linear timescale and the non-linear 6 timesc".

8 35. 6 computer apparatus capable of displaying a user interface configured to:
9 display a first set of images based ori a first attribute, the images of the first set being displayed along a first axis of images adjacently displaying images in a rectilinear fashion 11 on the display along a chronological order including a first timeline;
12 display a second set of images based on a second attribute, the images of the 13 second set being displayed along a second axis of images adjacently displaying images in 14 a rectilinear fashion on the display along the chronological order including a second timeline, the secOnd axis locating the images displayed thereon along the chronological order over a 16 plurality of time units, wherein the second timeline includes a non-linear timescale and a 17 time distribution that is substantially variable, with equal lengths of time being visually 18 represe'nted with unequal lengths of distance along the second axis of images; and 9 display a third set of images from the plurality of images based on a third attribute, the images of the third set being displayed along a third axis of images adjacently displaying 21 images:in a rectilinear fashion on the display along the chronological order including a third 22 timeline, the third axis locating the images displayed thereon along the chronological order 23 over a Plurality of time units, wherein the third timeline includes a non-linear timescale and 24 a time distribution that is substantially variable, with equal lengths of time being visually represented with unequal lengths of distance along the third axis of irnages, wherein the 26 units of=time of the third axis are chronologically shorter than the units of time of the second 27 axis.

29 36. the computer apparatus of claim 35, wherein the first axis includes years units of time, the units of time of the second axis are months, and the units of time of the third axis 31 are days.

Date Recue/Date Received 2021-03-30 29 1 37. The computer apparatus of any one of claims 35 and 36, wherein the first axis 2 includes a linear timescale and a time distribution that is substantially invariable, with equal 3 lengths:of time being visually represented with substantial equal lengths of distance along 4 the firstaxis of images.
6 38. The computer apparatus of any one of claims 35 to 37, further comprising a fourth 7 set of irnages displayable in an axis that is orthogonally located with respect to the first axis.

9 39. The computer apparatus of any one of claims 35 to 38, wherein the first axis, the second 'axis and the third axis are displayable vertically on the user interface.

12 40. The computer apparatus of any one of claims 35 to 39, wherein the graphical 13 interface is further configured to switch at least one of the timelines between a linear 14 timescale and the non-linear timescale.
16 41. A non-transitory computer-readable medium having stored thereon instructions that, 17 when eXecuted, provide a method of displaying photos, the method comprising:
18 (a) displaying an axis of an array of photos at separate display times in different manners 19 by switching between two different types of timescale used for a tirneline of the axis, the two different types of timescale comprising a linear timescale of the displayed axis and a 21 nonlinear timescale of the displayed axis, the step of displaying including 22 (i) displaying the axis with the timeline having a linear timescale by displaying photos 23 of the axis along the tirneline, the timescale of the timeline having a time distribution that is 24 substantially constant, wherein substantially equal periods of time are visually represented in subsiantially equal lengths of distance along the axis; and 26 (ii) displaying the axis with the timeline having a non-linear timescale by displaying 27 photos of the axis along the timeline at substantially constant intervals of distance between 28 adjacent photos on the axis, with at least one portion of the timeline being expanded to 29 accomn-iodate the evenly distributed graphical display of multiple photos on that portion of the timeline such that the timescale has a time distribution that ls substantially variable, 31 wherein substantially equal periods of time are visually represented in substantially unequal 32 lengths lof distance along the axis;
Date Recue/Date Received 2021-03-30 30 1 42. The non-transitory computer-readable medium of claim 41, wherein the first axis and 2 .. the second axis include photo in common.

4 43. The non-transitory computer-readable medium of any one of claims 41 and 42, .. wherein at least some of the photos are user-selectable.

7 44. The non-transitory computer-readable medium of any one of claims 41 and 43, 8 wherein the switching is progressive.

45. The non-transitory computer-readable medium of any one of claims 41 and 44, 11 .. wherein the axis is displayed vertically on a display.

13 46. The non-transitory computer-readable medium of any one of claims 41 and 45, 14 .. wherein the photos are displayed with a plurality of different axial sizes along the axis.
16 47. The non-transitory computer-readable medium of any one of claims 41 and 46, 17 wherein the photos are substantially equidistantly disposed from one another along the axis 18 .. photos.

48. The non-transitory computer-readable medium of any one of claims 41 and 47, 21 .. further comprising displaying time marks separating adjacent time units along the timeline.

23 49. The non-transitory computer-readable medium of any one of claims 41 and 48, 24 wherein the photos are displayed with a substantially quadrilateral shape.
26 50. The non-transitory computer-readable medium of any one of claims 41 and 49, 27 .. wherein photos between two adjacent time marks are displayed in a stacked configuration.

29 51. A method of:
(a) displaying an axis of an array of photos at separate display times in different manners 31 .. by switching between two different types of timescale used for a timeline of the axis, the two 32 different types of timescale comprising a linear timescale of the displayed axis and a 33 nonlinear timescale of the displayed axis, the step of displaying including Date Recue/Date Received 2020-06-15 1 (i) displaying the axis with the timeline having a linear timescale by displaying photos 2 of the axis along the timeline, the timescale of the timeline having a time distribution that is 3 substantially constant, wherein substantially equal periods of time are visually represented 4 in substantially equal lengths of distance along the axis; and (ii) displaying the axis with the timeline having a non-linear timescale by displaying 6 photos of the axis along the timeline at substantially constant intervals of distance between 7 adjacent photos on the axis, with at least one portion of the timeline being expanded to 8 accommodate the evenly distributed graphical display of multiple photos on that portion of 9 the timeline such that the timescale has a time distribution that is substantially variable, wherein substantially equal periods of time are visually represented in substantially unequal 11 lengths of distance along the axis;
12 (b) wherein the switching of the type of timescale of the axis between linear and 13 nonlinear timescales in displaying photos of the axis to the user is based on user interaction.

52. The method of claim 51, wherein the first axis and the second axis include photo in 16 common.

18 53. The method of any one of claims 51 and 52, wherein at least some of the photos are 19 user-selectable.
21 54. The method of any one of claims 51 to 53, wherein the switching is progressive.

23 55. The method of any one of claims 51 to 54, wherein the axis is displayed vertically on 24 a display.
26 56. The method of any one of claims 51 to 55, wherein the photos are displayed with a 27 plurality of different axial sizes along the axis.

29 57. The method of any one of claims 51 to 56, wherein the photos are substantially equidistantly disposed from one another along the axis photos.

32 58. The method of any one of claims 51 to 57, further comprising displaying time marks 33 separating adjacent time units along the timeline.

Date Recue/Date Received 2020-06-15 2 59. The method of any one of claims 51 to 58, wherein the photos are displayed with a 3 substantially quadrilateral shape.

60. The method of any one of claims 51 to 59, wherein photos between two adjacent 6 time marks are displayed in a stacked configuration.

8 61. A method of displaying, on a device, user-selectable elements from a collection of 9 user-selectable elements, the method comprising:
(a) displaying a portion of an axis of user-selectable elements of the collection on a 11 viewing area of the device, with a remainder of the user-selectable elements of the axis 12 being accessible through user navigation of the axis, user-selectable elements on the 13 displayed portion of the axis being disposed along a timeline in a chronological order, the 14 timeline having a linear timescale, wherein a plurality of first time units is visually represented with time marks being displayed on the axis separated at substantially equal lengths of 16 distance, with each of the plurality of first time units being displayed with a respective time 17 mark; and 18 (b) based on user interaction, displaying, in lieu of said displaying of step (a), a portion 19 of an axis of user-selectable elements of the collection on the viewing area of the device, with a remainder of the user-selectable elements of the axis being accessible through user 21 navigation of the axis, user-selectable elements on the displayed portion of the axis being 22 disposed along a timeline in a chronological order, the timeline having a non-linear 23 timescale, wherein a plurality of second time units is visually represented with time marks 24 being displayed on the axis separated at substantially unequal lengths of distance, with each of the plurality of second time units being displayed with a respective time mark and with at 26 least one user-selectable element being displayed with each second time unit, wherein the 27 displayed user-selectable elements in the second time units are having uneven axial 28 lengths.

62. The method of claim 61, wherein the axis of user-selectable elements is displayed 31 vertically on the viewing area of the device in said step (a), and wherein the axis of user-32 selectable elements is displayed vertically on the viewing area of the device in said step (b).

Date Recue/Date Received 2020-06-15 1 63. The method of any one of claims 61 and 62, further comprising, based on user 2 interaction, displaying, in lieu of said displaying of said steps (a) and (b), a portion of an axis 3 of user-selectable elements of the collection on the viewing area of the device, with a 4 remainder of the user-selectable elements of the axis being accessible through user navigation of the axis, user-selectable elements on the displayed portion of the axis being 6 disposed along a timeline in a chronological order, the timeline having a non-linear 7 timescale, wherein a plurality of third time units is visually represented with time marks being 8 displayed on the axis separated at substantially unequal lengths of distance, with each of 9 the plurality of third time units being displayed with a respective time mark and with at least one user-selectable element being displayed with each third time unit, wherein the displayed 11 user-selectable elements in the third time units are having uneven axial lengths.

13 64. The method of any one of claims 61 to 63, wherein the device is a mobile phone.

65. The method of any one of claims 61 to 64, wherein a user-selectable element is 16 commonly displayed in at least two of the first time units, the second time units and the third 17 time units in a substantially similar axial location along the axis.

19 66. The method of any one of claims 61 to 65, wherein at least some of the user-selectable elements are documents.

22 67. The method of any one of claims 61 to 66, wherein the user interaction is a gesture.

24 68. The method of any one of claims 61 to 67, wherein incremental units of time are not displayed in the timeline along the axis.

27 69. The method of any one of claims 61 to 68, wherein at least some of the user-28 selectable elements are pictures.

70. The method of any one of claims 61 to 69, wherein at least some of the user-31 selectable elements are videos.

Date Recue/Date Received 2020-06-15 1 71. A device, comprising a non-transitory computer-readable medium having stored 2 thereon computer-readable instructions that, when executed by the device, perform a 3 method for displaying user-selectable elements from a collection of user-selectable 4 elements, the device configured to:
(a) display a portion of an axis of user-selectable elements of the collection on a viewing 6 area of the device, with a remainder of the user-selectable elements of the axis being 7 accessible through user navigation of the axis, user-selectable elements on the displayed 8 portion of the axis being disposed along a timeline in a chronological order, the timeline 9 having a linear timescale, wherein a plurality of first time units is visually represented with time marks being displayed on the axis separated at substantially equal lengths of distance, 11 with each of the plurality of first time units being displayed with a respective time mark; and 12 (b) based on user interaction with the device, alternatively display a portion of an axis of 13 user-selectable elements of the collection on the viewing area of the device, with a 14 remainder of the user-selectable elements of the axis being accessible through user navigation of the axis, user-selectable elements on the displayed portion of the axis being 16 disposed along a timeline in a chronological order, the timeline having a non-linear 17 timescale, wherein a plurality of second time units is visually represented with time marks 18 being displayed on the axis separated at substantially unequal lengths of distance, with each 19 of the plurality of second time units being displayed with a respective time mark and with a user-selectable elements being displayed with each second time units, wherein the 21 displayed user-selectable elements in the second time units are having uneven axial 22 lengths.

24 72. The device of claim 71, wherein the axis of user-selectable elements is displayed vertically on the viewing area of the device in said step (a), and wherein the axis of user-26 selectable elements is displayed vertically on the viewing area of the device in said step (b).

28 73. The device of any one of claims 71 and 72, wherein the device is further configured 29 to displaying, based on user interaction, a portion of an axis of user-selectable elements of the collection on the viewing area of the device, with a remainder of the user-selectable 31 elements of the axis being accessible through user navigation of the axis, user-selectable 32 elements on the displayed portion of the axis being disposed along a timeline in a 33 chronological order, the timeline having a non-linear timescale, wherein a plurality of third Date Recue/Date Received 2020-06-15 1 time units is visually represented with time marks being displayed on the axis separated at 2 substantially unequal lengths of distance, with each of the plurality of third time units being 3 displayed with a respective time mark and with at least one user-selectable element being 4 displayed with each third time unit, wherein the displayed user-selectable elements in the third time units are having uneven axial lengths.

7 74. The device of any one of claims 71 to 73, wherein the device is a mobile phone.

9 75. The device of any one of claims 71 to 74, wherein a user-selectable element is commonly displayed in at least two of the first time units, the second time units and the third 11 time units in a substantially similar axial location along the axis.

13 76. The device of any one of claims 71 to 75, wherein at least some of the user-14 selectable elements are documents.
16 77. The device of any one of claims 71 to 76, wherein the user interaction is a gesture.

18 78. The device of any one of claims 71 to 77, wherein incremental units of time are not 19 displayed in the timeline along the axis.
21 79. The device of any one of claims 71 to 78, wherein at least some of the user-22 selectable elements are pictures.

24 80. The device of any one of claims 71 to 79, wherein at least some of the user-selectable elements are videos.

Date Recue/Date Received 2020-06-15