WO2014032088A1 - A method, application server, mobile communication device and multimedia terminal for displaying interactive multimedia - Google Patents

A method, application server, mobile communication device and multimedia terminal for displaying interactive multimedia Download PDF

Info

Publication number
WO2014032088A1
WO2014032088A1 PCT/AU2013/000951 AU2013000951W WO2014032088A1 WO 2014032088 A1 WO2014032088 A1 WO 2014032088A1 AU 2013000951 W AU2013000951 W AU 2013000951W WO 2014032088 A1 WO2014032088 A1 WO 2014032088A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
multimedia
processor
multimedia terminal
mobile communication
Prior art date
Application number
PCT/AU2013/000951
Other languages
French (fr)
Inventor
David CROPLEY
Original Assignee
Red Propaganda Pty Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from AU2012903687A external-priority patent/AU2012903687A0/en
Application filed by Red Propaganda Pty Ltd filed Critical Red Propaganda Pty Ltd
Publication of WO2014032088A1 publication Critical patent/WO2014032088A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/04Protocols specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network

Definitions

  • the present invention relates to digital display technology and in particular to a method, application server, mobile communication device and multimedia terminal tor displaying interactive multimedia.
  • the invention has beers developed primarily ior use in the display of mi brmation using a digital display for advertising, informational purposes and the like and will, be described hereinafter with reference to this application. However, it will be appreciated that the invention is not limited to this particular field of use,
  • a digital display device may display advertising material, shopping centre information and the like.
  • certain of these display devices may allow for user interaction, such as by the display of various options for finding a particular store (such as a map or categories of store) for selection by a user, typically by way of a touch sensitive display device, so as to display relevant information for the user.
  • a particular store such as a map or categories of store
  • existing digital display devices either do not allow user interaction, such as where a digital display simply displays the various repetitive information, or where a user interaction is allowed, such as where a display device comprises a. touch sensitive overlay, user interaction is limited to simple touch gestures.
  • the invention seeks to provide a method, application server, mobile communication device and multimedia terminal for displaying interactive multimedia which will overcome or substantially ameliorate at least some of the deficiencies of the prior art, or to at least provide ars alternative.
  • a method for displaying interactive multimedia comprising receiving interaction request data, representing an interaction request from a mobile communication device; and displaying, using a display device of a multimedia terminal, multimedia data representing multimedia in response to the interaction request data.
  • the method is adapted for allowing users to interact with advertising display boards and the like by using their mobile phones, tablets computers and the like.
  • the method further comprises displaying further multimedia data using a display device of the mobile communication device.
  • the user may receive options for selection using the mobile can indication device.
  • the method further comprises identifying the multimedia terminal from a set of multimedia terminals in accordance with the interaction request data.
  • the interaction request data comprises multimedia terminal identification data representing the identity of the multimedia terminal and wherein the method further comprises identifying the multimedia terminal using the multimedia terminal identification data.
  • the method is adapted for allowing two or more multimedia terminals to be coupled to an application server wherein the application server is able to discriminate the multimedia terminal for the display of multimedia data in accordance with the interaction request data.
  • the interaction request data comprises barcode scan, image data, representing a. scan of a barcode.
  • the method is adapted for allowing users to use commonly available cameras of a mobile phone devices to capture the barcode.
  • the barcode scan image data encodes a uniform resource locator.
  • the uniform resource locator allows for the implementation of an HTTP platform wherein the uniform resource locator points to an application server for the recordable of the interaction request.
  • the method further comprises displaying, using the display device, the barcode.
  • the method further comprises displaying, using the display device, a further barcode after receipt of the interaction request data.
  • the method is adapted for allowing the interaction of two or more users with the multimedia terminal, wherein the barcode may be updated once "used" so as to distinguish a second user.
  • the method further comprises displaying, using the display device, unique key data representing a key; receiving, from the mobile communication device, input key data representing an input key: and identifying the multimedia terminal fforn a set of multimedia terminals in accordance with the unique key data, and the input key data.
  • the method is adapted for display in a unique key using the display device of the multimedia terminal, such that a user may enter the unique key into their mobile phone such that the application server is able to pair the multimedia terminal and the mobile phone.
  • the method further comprises, receiving, via. an input device of the mobile communication device, user selection data representing user selection; and displaying, using the display device, further multimedia data in accordance with the user selection data.
  • the method is adapted for allowing users to use their mobile phones in a similar manner as to a remote control device wherein, one or more options displayed by the mobile communication device for selection by the user.
  • the user may control the display of content of the multimedia terminal .
  • the method further comprises receiving image capture request data representing an image capture request from the mobile communication device, and capturing image data, using an image capture device of the multimedia terminal.
  • the method further comprises displaying the image data using the display device.
  • the method further comprises sending the image data to the mobile communication device, and displaying the image data using the display device.
  • the method further comprises displaying a video feed data from the image capture device using the display device and, upon receipt of the image capture request data, capturing image data from the video feed data.
  • the method is adapted for allowing users to capture image data from an image capture device of the multimedia terminal.
  • users may pose tor photos for capture and display by the multimedia terminal.
  • the method further comprises receiving further interaction request data representing a further interaction request from a further mobile comnrs.mica.tion device; aim displaying, using the display device of a multimedia terminal, the multimedia data further in response to the interaction request data.
  • the method is adapted for allowing multiple user interaction with the multimedia terminal.
  • an application server for facilitating the display of interactive multimedia
  • the application server comprising: a. processor for processing digital data; and a memory device for storing digital data including computer program code and being coupled to the processor, a. network interface for sending md receiving digital data, across a data network, wherein the processor is controlled by the computer program code to: receive, via the network interface, interaction request data representing an interaction request from a mobile communication device; and send, via the network interface, multimedia data to a multimedia terminal representing multimedia in response to the interaction request data.
  • the processor is further controlled by the computer program code to send, via the network interface, farther multimedia data to the mobile communication device.
  • the processor is further controlled by the computer program code to identify the multimedia terminal from a. set of multimedia, terminals in accordance with the interaction request data.
  • the interaction request data comprises nrultimedia terminal identification data representing the identity of the multimedia terminal and wherein the processor is further controlled by the computer program code to identify the multimedia terminal using the multimedia terminal identification data.
  • the interaction request data comprises barcode scan image data representing a scan of a barcode.
  • the barcode scan image data encodes a uniform resource locator.
  • the processor is further controlled by the computer program code to send, via the network interface, barcode data representing the barcode.
  • the processor is further controlled by the computer program code to send, via the network interface, further barcode data representing a further barcode after receipt of the interaction request data.
  • the processor is further controlled by the computer program code to send via the network interface, unique key data representing a key; receive, vra the network interface, input key data representing a.n input key; and identify the multimedia terminal from a set of multimedia terminals in accordance with the unique key data and the input key data.
  • the processor is further controlled by the computer program code to receive, via the network interface, user selection data representing user selection; and send, via the net interface, further multimedia data in accordao.ee with the user selection data.
  • the processor is further controlled by the computer program code to receive, via the network interface, image capture request data representing an image capture request, and receive, via the network interface, image capture data from m image capture device of the multimedia terminal.
  • the processor is further controlled by the computer program code to send, via the network interface, the image data, for display by the display device.
  • the processor is further controlled by the computer program code to send, via the network interface, the image data to the mobile communication device.
  • the processor is farther controlled by the computer program code to receive, via the network interface, video feed data from the image capture device, and upon receipt of the image capture request data, capture image data from the video feed data.
  • the processor is further controlled by the computer program code to receive, via the network interface, further interaction request data representing a further interaction request from a further mobile communication device; and display, using the display device of a multimedia terminal, the multimedia data further in response to the interaction request data.
  • a mobile communication device for facilitating the display of interactive multimedia
  • the mobile communication device comprising a processor for processing digital data; and a memory device for storing digital data including computer program code and being coupled to the processor, a data scanning device for scanning digital data and being coupled to the processor, a network interface for sending and receiving digital data across a data network, wherein the processor is controlled by the computer program code to scars, using the data scanning device, multimedia terminal identification data from a data bearing device; send.
  • interaction request data representing an interaction request, wherein the interaction request data comprises the multimedia terminal identification data.
  • the processor is further controlled by the computer program code to receive, via. the network interface, multimedia data.
  • the data scanning device comprises a barcode scanner, and wherein the multimedia terminal identification data is encoded in barcode image scan data.
  • the barcode scan image data encodes a uniform resource locator.
  • the processor is further controlled by the computer program code to send, via the network interface, the barcode scan image data.
  • the data scanning device comprises a radiofrequency near field connm.mica.don device.
  • the mobile communication device further comprises an input interface adapted for receiving user input and wherein the processor is further controlled, by the computer program code to receive, via the input interface, input key data representing an input key: send, via the network interlace, the input key data.
  • the mobile communication device further comprises an input interlace adapted for receiving user input and wherein the processor is further controlled by the computer program code to receive, via the network interface, option data representing a set of options; receive, via the input interface, user selection data representing user selection from the set of options; and send, via the network interface, the user selection data.
  • option data representing a set of options
  • user selection data representing user selection from the set of options
  • the mobile communication device further comprises an input interface adapted for receiving user input and wherein the processor is further controlled by the computer program code to receive, via the user input interface, image capture request data representing an image capture request, and send, via the network interface, the image capture request data.
  • the processor is further controlled by the computer program code to receive, via the network interface, image data.
  • a multimedia terminal for facilitating the display of interactive multimedia
  • the multimedia terminal comprising a processor for processing digital data.; and a memory device for storing digital data, including computer program code and being coupled to the processor, a display device for displaying digital data and being coupled to the processor, a network interface for sending and receiving digital data across a data network, wherein the processor is controlled by the computer program code to: display, using the display device, multimedia terminal identification data representing the identification of the multimedia terminal; receive, via the network interface, multimedia data representing multimedia from the application server, the multimedia data is selected in accordance with an interaction request: and display, using the display device, the multimedia data.
  • the multimedia terminal identification data comprises barcode data representing a barcode.
  • the barcode data encodes a uniform resource locator.
  • the multimedia terminal further composes an image capture device adapted for capturing image data and being coupled to the processor, wherein the processor is further controlled by the computer program code to receive, via the network interface, image capture request data representing an image capture request, and capture, using image capture device, image data.
  • image capture request data representing an image capture request
  • image capture device image data
  • Pig. 1 shows a computing device on which the various embodiments described herein may be implemented in accordance with an embodiment of the present invention
  • Fig. 2 shows a network of computing devices on which the various embodiments described herein may be implemented in accordance with an embodiment of the present Invention
  • Fig, 3 shows a method for displaying interactive multimedia in accordance with a preferred embodiment of the present invention.
  • Pigs. 4 to 6 show exemplary graphical user interfaces of a multimedia terminal and communication device in the display of interactive multimedia in accordance with another embodiment of the present invention.
  • Fig. 1 shows a computing device 100 on which the vanous embodiments described herein may be implemented
  • the computing device 100 may take on differing configurations in the implementation of displaying interactive multimedia.
  • the computing device 100 may take the form of a mobile communication device, application server, multimedia terminal and the like.
  • the steps of the method of displaying interactive multimedia described below may be implemented as computer program code instructions executable by one or more computing devices 100.
  • the computer program code instructions may be divided into one or more computer program code instruction libraries, such as dynamic link libraries (DLL), wherein each of the libraries performs a one or more steps of the method. Additionally, a subset of the one or more of the libraries may perform graphical user interface tasks relating to the steps of the method.
  • DLL dynamic link libraries
  • the device 100 comprises semiconductor memory 1 10 comprising volatile memory such as random access memory (RAM ) or read only memory (ROM ).
  • the memory 100 may comprise either RAM or ROM or a combination of RAM and ROM.
  • the device 100 comprises a computer program code storage medium reader 130 for reading the computer program code instructions from computer program code storage media 120.
  • the storage media 120 may be optical media such as CD-ROM disks, magnetic media such as floppy disks and tape cassettes or flash media such as USB memory sticks.
  • the device further comprises I/O interface 140 for communicating with one or more peripheral devices.
  • the I/O interface 140 may offer both serial and parallel interface connectivity.
  • the I/O interface 140 may comprise a Small Computer System interface (SCSI), Universal Serial Bus (USB) or similar I/O interface for interfacing with the storage medium reader 130.
  • the I/O interface 140 may also communicate with one or more human, input devices (HID) 160 such as keyboards, pointing devices, joysticks and the like.
  • the I/O interface 140 may also compose a. computer to computer interface, such as a. Recommended. Standard 232 (RS-232) interface, for interfacing the device 100 with one or more personal computer (PC) devices 190.
  • the I/O interface 140 may also comprise an audio interface for communicate audio signals to one or more audio devices 1050, such as a speaker or a buzzer.
  • the device 100 also comprises a network interface 170 for communicating with one or more computer networks 180,
  • the network 1 80 may be a wired network, such as a wired Ethernet iiVi network or a wireless network, such as a Bluetooth lU network or IEEE 802.11 network.
  • the network 180 may be a local area network (CAN), such as a home or office computer network, or a wide area network (WAN), such as the Internet or private WAN,
  • CAN local area network
  • WAN wide area network
  • the device 100 comprises an arithmetic logic unit or processor 1000 for performing the computer program code instructions.
  • the processor 1000 may be a reduced instruction set computer (RISC) or complex instruction set computer (CISC) processor or the like.
  • the device 100 further comprises a storage device 1030, such as a magnetic disk hard drive or a solid state disk dnve.
  • Computer program code instructions may be loaded into the storage device 1030 from the storage media 120 using the storage medium reader 130 or from the network 180 using network interface 170.
  • the processor 1000 fetches computer program code instructions from memory 1 10, decodes the instructions into machine code, executes the instructions and stores one or more intermediate results in memory 100. in tins manner, the instructions stored in the memory 110, when retrieved and executed by the processor 1000, may configure the computing device 100 as a special -purpose machine that may perform the functions described herein.
  • the device 100 also comprises a video interface 1010 for conveying video signals to a display device 1020, such as a liquid crystal display (LCD), cathode-ray tube (CRT) or similar display device.
  • a display device 1020 such as a liquid crystal display (LCD), cathode-ray tube (CRT) or similar display device.
  • LCD liquid crystal display
  • CRT cathode-ray tube
  • the computing device 100 further comprises an image capture device 105 for capturing image arsd video data.
  • the computing device 100 ideally comprises the image capture device 105 when the computing device 100 is configured as a multimedia terminal so as to image capture and video data for the purposes of incorporation into the dynamic multimedia content.
  • the device 100 also comprises a communication bus subsystem 150 for interconnecting the various devices described above.
  • the bus subsystem 150 may offer parallel connectivity such as industry Standard Architecture (ISA), conventional Peripheral Component Interconnect (PCI) and the like or serial connectivity such as PCI Express (PCle), Serial Advanced Technology Attachment (Serial ATA) aixl the like.
  • ISA industry Standard Architecture
  • PCI Peripheral Component Interconnect
  • PCle Peripheral Component Interconnect
  • Serial ATA Serial Advanced Technology Attachment
  • Fig. 2 shows a network 200 of computing devices 100 on which the various embodiments described herein may be implemented.
  • the network 200 comprises at least one multimedia terminal 205.
  • the multimedia terminal 205 is used for displaying interactive multimedia in the manner described herein.
  • the multimedia terminal 205 may take on different forms depending on the application but in a preferred embodiment, the multimedia terminal 205 comprises a display device 1020 such as an LCD or plasma display device.
  • the multimedia terminal would be located in public allowing members of the public to interact with the multimedia terminal 205.
  • the multimedia terminal 205 may be fastened to a wall, stand or the like in a shopping centre and having a large display device 1020 for display multimedia content.
  • the multimedia content relates to advertising goods or services but this need not necessarily be the case.
  • the multimedia content may relate to navigation thereby allowing a shopper to find a particular store in an interactive manner as described herein.
  • the multimedia terminal 205 comprises an image capture device 105.
  • the image capture device 105 may be located at an edge of the display device 1020 tor the purposes of capturing image and video data in the manner described herein.
  • the network further comprises at least one mobile communication device 210, such as a mobile phone, portable computer and the like.
  • the mobile communication device 210 farther comprises a. display device 1020 tor displaying information to the user.
  • the network 200 further comprises a data network 180, described in the embodiment given as the Internet 230, As is apparent, the mobile communication device 210 is m communication with the multimedia terminal 205 across the Internet 230. In this manner, the multimedia terminal 205 and the mobile communication device 210 co-operate so as to allow the display of interactive multimedia content by the multimedia terminal 205.
  • the network 200 comprises an application server 235.
  • the application server 235 may marshal communication between the mobile communication device 210 and the multimedia terminal 205,
  • the application server 235 may comprise a database for storing digital information including multimedia content.
  • the multimedia terminal 205 may comprise an application server 235 responses to requests from the mobile communication device 210 such feat no externally located application server 235 is required.
  • the application server 235 takes the form of a web server, wherein the multimedia terminal 205 and the mobile conroiunicadon device 210 execute a browser application for the purposes of sending and receiving HTML requests and rendering HTML data, in tins manner, the application server 235 is provided with a web server application for receiving requests, such as Hypertext Transfer Protocol (HTTP) and File Transfer Protocol (FTP) requests, and serving hypertext web pages or files in response.
  • HTTP Hypertext Transfer Protocol
  • FTP File Transfer Protocol
  • the web server application may be, for example the Apache i3 ⁇ 4 " or the Microsoft ,3 ⁇ 44 IIS HTTP server.
  • the application server 235 is also provided with a hypertext preprocessor for processing one or more web page templates and data from one or more databases to generate hypertext web pages.
  • the hypertext preprocessor may, for example, be the PHP: Hypertext Preprocessor (PHP) or Microsoft Asp s M hypertext preprocessor.
  • the application server 235 is also provided with web page templates, such as one or more PHP or ASP files.
  • the hypertext preprocessor Upon receiving a request from the web server application, the hypertext preprocessor is operable to retrieve a web page template, from the web page templates, execute my dynamic content therein, including updating or loading information from the one or more databases, to compose a hypertext web page.
  • the composed hypertext web page may comprise client side code, such as Javascript, for Document Object Model (DOM) manipulating, asynchronous HTTP requests and the like.
  • the mobile communication device 210 and the multimedia terminal are provided with a browser application, such as the Moxiila Firefox'"" or Microsoft Internet Explorer'*' browser applications.
  • the browser application requests hypertext web pages from the application server 235 and renders the hypertext web pages on a display device 1020.
  • Fig. 3 shows a computer implemented method 300 for displaying interactive multimedia.
  • the method 300 is executed by one or more computing devices 100 and in particular one or more computing devices 100 connected across the Internet 230 as substantially shown in Fig. 2.
  • the method 300 starts at step 305 with the application server 235 receives interaction request data representing an interaction request from the mobile communication device 210.
  • the multimedia terminal 205 displays advertising information 482 a company.
  • the most media terminal 205 may be located within a shopping centre, for example.
  • the multimedia terminal 205 comprises an image capture device 105 for capturing image and video data in the manner described further below.
  • the barcode 405 is scanned by the mobile communication device 210 to initiate interaction with the multimedia terminal 205.
  • the multimedia terminal 205 poses the question "where would you like to go today?" As such, a shopper may be interested in embarking on a luxury tour to a foreign destination and will therefore use their mobile communication device 210 to interact with a multimedia terminal 205 to find out more information about the available luxury tours.
  • the barcode 405 may encode a URL, wherein the URL composes multimedia terminal, identification data.
  • the URL that may be encoded by the barcode 405 may be: h hp :// w w w .redpropagan da, com .an/di splay i d ::::: 145
  • the URL encodes a unique multimedia terminal identification number 145, As will become apparent from the below description, the application server 235 will use this unique multimedia terminal identification number 145 to identify the correct multimedia terminal for which to display the interactive multimedia.
  • step 305 the application server identifies the display device from a set of display devices in accordance with the interaction request data.
  • the application server 235 database comprises a lookup table of the media terminals 205 such that the application server 235 may send the multimedia content to the appropriate multimedia terminal 205.
  • the multimedia content of the multimedia terminal 205 may comprise client side scripting such as JavaScript for the purposes of periodically polling die application server 235 to ascertain an interaction request.
  • client side scripting such as JavaScript for the purposes of periodically polling die application server 235 to ascertain an interaction request.
  • the URL points to the application server 235 such that the application server 235 receives the HTM L GET request from the mobile communication device 210 comprising the unique identification of the multimedia terminal 205.
  • the application server 235 updates the database or session variable to indicate that an interaction request is pending for the multimedia terminal 205.
  • the multimedia terminal 205 then sends an asynchronous poll to the application server 235 to ascertain the existence of an interaction request.
  • the multimedia terminal 205 may then begin interacting with the user.
  • the browser application of the multimedia terminal 205 may be adapted to periodically refresh. At each refresh the application server 235 is simply adapted to serve the same webpages such that the display appears static to the user. However, after receipt of an interaction request from the mobile communication device 210, the application server 235, upon receipt of the refresh request from the multimedia terminal 205 may then be adapted to serve s.n alternate web page.
  • the multimedia terminal 210 is adapted for displaying, using the display device 1020 of a multimedia terminal 210, multimedia data representing multimedia in response to the interaction request data.
  • a barcode 405 is described herein as the preferred embodiments for allowing a user to initiate the interaction with the multimedia terminal 210
  • other mechanisms may be adapted for allowing a user to initiate the interaction.
  • a near field communication (NFC) tag may be located at the multimedia terminal 205.
  • the user's mobile communication device 210 having a NFC reader may simply swipe the mobile communication device 210 over the NFC tag to read the data encoded wiihm the NFC tag.
  • the NFC tag may encode the URL data described above such that the mobile communication device 210 may browse to the application server 235.
  • the state of the multimedia terminal 205 aim the mobile communication device 210 at the initiation of interaction.
  • the display device 1020 of the multimedia terminal 205 now displays a series of options available to the user.
  • the multimedia terminal 205 comprises three options comprising option A for Spam, option B for Cape Ibwn and option C for Sydney.
  • the mobile communication device 210 will also receive HTML content for rendering back from the application server 235.
  • the mobile communication device 210 similarly displays of the three options for the user selection.
  • the options available for selection may be HTML hyperlinks such that the user need simply select the appropriate hyperlink to send the user preference back to the application server 235,
  • the mobile communication device 210 would send an action request to be application server 235 comprising the option fur Spain, whereafter the application server 235 may then be adapted to serve webpages relating to Spain at the next refresh request from the multimedia terminal 205.
  • the application server 235 is adapted to allow two or more users to interact with the multimedia terminal 205. In this maimer, they first user may scan the barcode 405 and a second user may also scan the same barcode 405, wherein the application server 235 initiates separate sessions for each interaction reqnest.
  • the application server 235 is adapted to serve md updated webpage to the mobile terminal 205 composing a differing barcode 405. In this manner, onee a barcode 405 has been "used" to reqnest an interaction, a further "new" barcode 405 may be displayed for a next scan.
  • the display device 1020 of the multimedia terminal 205 may simply comprise a URL to winch users may manually browse.
  • the application server 235 may not know which is the applicable multimedia terminal 205, as such, in this embodiment, the application server 235 may be adapted to display a unique key, such as a four digit pin on multiple multimedia terminals 205 wherein a unique four digit pin is displayed on each multimedia terminal. For example, in a first multimedia terminal 205a there may be displayed the four digit pin "1235" and on a second multimedia terminal 205b there may be displayed another four digit and "7419". The user is then instructed to input the four digit pin into their mobile communication device 210, Upon receipt of the four digit pin, the application server 235 is then able to ascertain which multimedia terminal 205 is the appropriate multimedia terminal tor display of the multimedia content.
  • the system 200 is adapted to allow a user to image capture or video data.
  • the multimedia terminal 205 comprises an image capture device 105.
  • the image capture device 105 may be adapted to image capture data from the image capture device 105 for display on the display device 1020 of the multimedia terminal 205.
  • the image data captured from the image capture device may additionally be displayed on the display device 1020 of the mobile communication device 210.
  • Suitable client side scripting such as Macromedia Flash may be used for the purposes of capturing image data.
  • the multimedia terminal 205 displays image data 605 representing the image data captured from the field of view of image capture device 105, As is apparent from the image data 605, four persons are standing in front of the multimedia terminal 205.
  • the display device 1020 of the mobile communication device 210 ftrriher displays the image data 605 in one embodiment.
  • the mobile communication device 210 also allows the user to take a photo by the provision of a hyperlink labelled "take photo".
  • the video data is shown by the display device 1020 of the multimedia terminal 205 such that the user's may pose and wherem, after having selected the "take photo" hyperlink, the multimedia terminal 205 is adapted to capture the image data from the video data.
  • various advertising material overlay may be applied to the image data, such as the logo for lifetime tours arm the like.
  • an adjacent printing device may be on hand for printing any captured image data.
  • a multimedia terminal 205 taking the form of an electronic display board, such as electronic display board comprising a plurality of plasma, LCD or other digital display devices 1020 arranged together to form the electronic display board, so as to, for example provide a display board of 4 m in width and 1.5 m in height.
  • an electronic display board such as electronic display board comprising a plurality of plasma, LCD or other digital display devices 1020 arranged together to form the electronic display board, so as to, for example provide a display board of 4 m in width and 1.5 m in height.
  • the display device 1020 or multimedia terminal 205 will display a suitable instruction to encourage the air passenger to interact with the multimedia terminal 205, such as "snap to interact", "swipe me” or the like. In this manner, adjacent the multimedia terminal 205, or displayed by the display device 1020 itself may be displayed a 2D barcode (encoding a URL in one embodiment as described above). As also described above, in one embodiment there would be a NFC/RFID tag or the like arranged next to the display device 1020,
  • the browser 215 of the user's mobile communication device 210 will browse to the URL encoded by the 2D barcode or NFC tag. Having received the HTTP request the application server 235 is able to identify the multimedia terminal 205 accordingly so as to update the display device 1020 of the appropriate multimedia terminal 205 accordingly.
  • the display device 1020 of the multimedia terminal 205 may display information such as "connecting... and then render a new HTML page or the like.
  • the display device 1020 will display a plurality of multimedia entertainment items winch may be downloaded by the passenger.
  • the multimedia entertainment items would be displayed by the display device 1020 of the mobile communication device 210.
  • a plurality of electronic books may be displayed to the passenger.
  • each gesture performed by the user using the mobile communication device 210 may be relayed to the application server 235 via standard HTTP request, such as a page refresh request, Ajax request or the like.
  • the application server 235 is able to ascertain the user's gesture from the HTTP requests so as to update the display device 1020 of the multimedia terminal 205 accordingly.
  • the application server 235 may be co-located with the multimedia terminal 205 and provided with a static IP address so as to be able to serve a web resource such that the mobile communication devices 210 may send HTTP requests directly to the application server 235 of the multimedia terminal 205,
  • the multimedia terminal 205 may be adapted such that the display device 1020 splits into two separate session portion displays allowing each passenger to separately interact with the multimedia terminal 205.
  • the multimedia terminal 205 may allow multiple users to interact simultaneously so as to, using this example, simultaneously interact in the selection of multimedia content for download.
  • other user interaction may be afforded, such as by allowing multiple users to play interactive games, such as the retro arcade style game "pong" where each player controls a respective paddle or the bke.
  • the passenger may select the electronic book for purchase.
  • the browser 215 of the mobile communication device 210 may then redirect to appropriate software application of the passengers mobile communication device 210 or a payment processing webpage so as to allow the passenger to complete the purchase and so as to end the passenger's session with the multimedia terminal 205.
  • the mobile communication device 210 of tbe passenger may have stored in the URL associated, with the multimedia terminal 205 in cache.
  • the multimedia terminal 205 may be adapted to display a physical presence challenge, such as displaying a code for entry by the passenger to verify that the passenger is proximate the multimedia terminal 205,
  • the location information may be sent by the mobile communication device 210 so as to satisfy the application server 235 that the passenger is actually present at the multimedia terminal 205.
  • location information may be obtained from the Wi-Fi hotspot for example or alternatively the GPS or other location mechanism of tbe user's mobile can indication device 210,
  • the embodiments described herein may be suited for use in boardrooms where a presenter may utilise their mobile communication device 210 for the purposes of controlling the presentation.
  • Such an embodiment is especially suited for Web-based presentation software and the like where a presentation is served by a. Web server such as by usmg HML, Adobe Flash or the like.
  • the presenter may use the presenter's mobile communication device to control the flow of the presentation.
  • NFC tag or the like may be located at a suitable location, such as at the centre of the boardroom table.
  • the presenter may simply swipe the presenter ' s mobile communication device 215 over the NFC tag such that the appropriate presentation is displayed by the display device 1020 of the multimedia terminal 205.
  • the mobile communication device 210 of the present may display appropriate control icons, such as backwards, forwards and the like. In this manner, using the controls, the presenter may control the flow of the presentation.
  • tbe mobile communication device 210 of the present may be adapted to store session information, such as by way of a cookie or the like such that dining a predeiemvined session period the presenter may reinitiates the presentation.
  • bus and its derivatives, while being described in a preferred embodiment as being a communication bus subsystem for interconnecting various devices including by way of parallel connectivity such as Industry Standard Architecture (ISA), conventional Peripheral Component Interconnect (PCI) and the like or serial connectivity such as PCI Express (PCIe), Serial Advanced Technology Attachment (Serial ATA) and the like, should be construed broadly herein as any system for communicating data.
  • parallel connectivity such as Industry Standard Architecture (ISA), conventional Peripheral Component Interconnect (PCI) and the like or serial connectivity such as PCI Express (PCIe), Serial Advanced Technology Attachment (Serial ATA) and the like
  • PCIe PCI Express
  • Serial Advanced Technology Attachment Serial ATA
  • tin accordance with' may also mean 'as a function of and is not necessarily limited to the integers specified In relation thereto.
  • 'a computer implemented method' should not necessarily be inferred as being performed by a single computing device such that the steps of the method may be performed by more than one cooperating computing devices.
  • objects as used herem such as 'web server', "server', 'client computing device', 'computer readable medium' and the like should not necessarily be construed as being a single object, and may be implemented as a two or more objects in cooperation, such as, for example, a web server being construed as two or more web servers in a server farm cooperating to achieve a desired goal or a computer readable medium being distributed in a composite manner, such as program code being provided on a compact disk activatable by a license key downloadable from a. computer network.
  • database and its derivatives may be used to describe a single database, a set of databases, a system of databases or the like.
  • the system of databases may comprise a set of databases wherein the set of databases may be stored on a single implementation or span across multiple implementations.
  • database is also not limited to refer to a certain database forrnat rather may refer to any database format.
  • database formats may include MySQL, MySQL! , XML or the like.
  • the invention may be embodied using devices conforming to other network standards and for other applications, including, for example other WLAN standards and other wireless standards.
  • Applications that can be accommodated include IEEE 802.11 wireless LANs and links, and wrreless Ethernet.
  • wireless '5 and its derivatives may be used to describe circuits, devices, systems, methods, techniques, communications channels, etc, that may communicate data, through the use of modulated electromagnetic radiation through a non-solid medium. The term does not imply that the associated devices do not contain any wires, although in some embodiments they might not.
  • the term "wired” and its derivatives may be vised to describe circuits, devices, systems, methods, techniques, communications channels, etc., that may communicate data through the use of modulated electromagnetic radiation through a solid medium. The term does not imply that the associated devices are coupled by electrically conductive wires.
  • processor may refer to any device or portion of a device that processes electronic data, eg , from registers and/or memory to transform that electronic data into other electronic data that, e.g., may be stored in registers and/or memory.
  • a "computer” or a. "computing device” or a “computing machine” or a “computing platform” may include one or more processors.
  • the methodologies described herein are, in one embodiment, performable by one or more processors that accept computer-readable (also called machine-readable) code containing a set of instructions that when executed by one or more of the processors carry out at least one of the methods described herein.
  • Any processor capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken are included.
  • a typical processing system that includes one or more processors.
  • the processing system further may include a memory subsystem including mam RAM and/or a static RAM, and/or ROM,
  • a computer-readable earner medium may form, or be included in a computer program product
  • a computer program product ca.n be stored on a computer usable carrier medium, the computer program product comprising a computer readable program means for causing a processor to perform a method as described herein.
  • the one or more processors operate as a standalone device or may be connected, e.g., networked to other processors), in a networked deployment, the one or more processors may operate in the capacity of a server or a client machine in server-client network environment, or as a peer machine in a peer-to-peer or distributed network environment.
  • the one or more processors may form a web appliars.ee, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
  • machine straii also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
  • one &mho&rmni of each of the methods described herein is in the form of a computer- readable carrier medium carrying a set of instructions, e.g., a computer program that are for execution on one or more processors.
  • a computer-readable carrier medium carrying a set of instructions, e.g., a computer program that are for execution on one or more processors.
  • embodiments of the present invention may be embodied as a method, an apparatus such as a special purpose apparatus, au apparatus such as a data processing system, or a computer-readable carrier medium.
  • the computer-readable carrier medium carries computer readable code including a set of instructions that when executed on one or more processors cause a processor or processors to implement a method.
  • aspects of the present invention may take the form of a method, an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects.
  • the present invention may take the form of carrier medium (e.g., a computer program product on a computer-readable storage medium) carrying computer-Tearlable program code embodied in the medium.
  • tbe carrier medium is shown in an example embodiment to be a single medium, tbe term "carrier medium” should be taken to include a single medium or multiple media (e.g., a centralized or distribu ted database, a rubor associated cacbes and servers) tbat store the one or more sets of instructions.
  • carrier medium shall also be taken to include any medium that is capable of storing, encoding or carrying a set of instructions for execution by one or more of the processors and that cause the one or more processors to perform any one or more of the methodologies of the present invention.
  • a carrier medium may take many forms, including but not limited to, non- volatile media, volatile media, aud transmission media.
  • a processor with the necessary instructions for carrying out such a method or element of a method forms a means for carrying out tbe method or element of a method.
  • an element described herein of an apparatus embodiment is an example of a means for carrying out the function performed by tbe element for the purpose of carrying out the invention.
  • tbe term connected when used in the claims, should not be interpreted as being limitative to direct connections only.
  • the scope of the expression a device A connected to a device B should not be limited to devices or systems wherein an output of device A is directly connected to an input of device B. It means that there exists a path between an output of A and an input of B which may be a path including other devices or means.
  • Connected may mean that two or more elements are either in direct physical or electrical contact or that two or more elements are not in direct contact with each other but yet still cooperate or interact with each other.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • General Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Physics & Mathematics (AREA)
  • Finance (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Game Theory and Decision Science (AREA)
  • Multimedia (AREA)
  • Information Transfer Between Computers (AREA)
  • Telephonic Communication Services (AREA)

Abstract

There is provided a method (300) for displaying interactive multimedia, the method (300) comprising receiving interaction request data representing an interaction request from a mobile communication device (210) and displaying, using a display device (1020) of a multimedia terminal (205), multimedia data representing multimedia in response to the interaction request data.

Description

A METHOD, APPLICATION SERVER, MOBI LE CXIMMIJMCATJON DEVICE AND MULTIMEDIA TERMINAL FOR DISPLAYING INTEMACTP/E MULTIMEDIA
Field of the Invention
The present invention relates to digital display technology and in particular to a method, application server, mobile communication device and multimedia terminal tor displaying interactive multimedia.
The invention has beers developed primarily ior use in the display of mi brmation using a digital display for advertising, informational purposes and the like and will, be described hereinafter with reference to this application. However, it will be appreciated that the invention is not limited to this particular field of use,
Backgrouud in certain applications, traditional advertising boards, posters, billboards and the like have been replaced by digital display boards so as to increase customer engagement. For example, in a shopping centre, a digital display device may display advertising material, shopping centre information and the like.
Furthermore, certain of these display devices may allow for user interaction, such as by the display of various options for finding a particular store (such as a map or categories of store) for selection by a user, typically by way of a touch sensitive display device, so as to display relevant information for the user.
However, existing digital display devices either do not allow user interaction, such as where a digital display simply displays the various repetitive information, or where a user interaction is allowed, such as where a display device comprises a. touch sensitive overlay, user interaction is limited to simple touch gestures.
It is to be understood that, if any prior art information is referred to herein, such reference does not constitute an admission that the information forms part of the common general knowledge in the art, in Australia or any other country,
Summary
The invention seeks to provide a method, application server, mobile communication device and multimedia terminal for displaying interactive multimedia which will overcome or substantially ameliorate at least some of the deficiencies of the prior art, or to at least provide ars alternative. According to one aspect, there is provided a method for displaying interactive multimedia, the method comprising receiving interaction request data, representing an interaction request from a mobile communication device; and displaying, using a display device of a multimedia terminal, multimedia data representing multimedia in response to the interaction request data.
Advantageously, the method is adapted for allowing users to interact with advertising display boards and the like by using their mobile phones, tablets computers and the like.
Preferably, the method further comprises displaying further multimedia data using a display device of the mobile communication device.
Advantageously, not only is the method for ad adapted for updating the multimedia of the display device of the multimedia terminal, but also for displaying relevant multimedia on the display device of the mobile communication device. In this maimer, the user may receive options for selection using the mobile can indication device.
Preferably, the method further comprises identifying the multimedia terminal from a set of multimedia terminals in accordance with the interaction request data.
Preferably, the interaction request data comprises multimedia terminal identification data representing the identity of the multimedia terminal and wherein the method further comprises identifying the multimedia terminal using the multimedia terminal identification data.
Advantageously, the method is adapted for allowing two or more multimedia terminals to be coupled to an application server wherein the application server is able to discriminate the multimedia terminal for the display of multimedia data in accordance with the interaction request data.
Preferably, the interaction request data, comprises barcode scan, image data, representing a. scan of a barcode.
Advantageously, the method is adapted for allowing users to use commonly available cameras of a mobile phone devices to capture the barcode.
Preferably, the barcode scan image data encodes a uniform resource locator.
Advantageously, the uniform resource locator allows for the implementation of an HTTP platform wherein the uniform resource locator points to an application server for the recordable of the interaction request.
Preferably, the method further comprises displaying, using the display device, the barcode.
Preferably, the method further comprises displaying, using the display device, a further barcode after receipt of the interaction request data. Advantageously, the method is adapted for allowing the interaction of two or more users with the multimedia terminal, wherein the barcode may be updated once "used" so as to distinguish a second user.
Preferably, the method further comprises displaying, using the display device, unique key data representing a key; receiving, from the mobile communication device, input key data representing an input key: and identifying the multimedia terminal fforn a set of multimedia terminals in accordance with the unique key data, and the input key data.
Advantageously, in embodiments where the identification of the multimedia terminal is not able to be ascertained from the interaction request, the method is adapted for display in a unique key using the display device of the multimedia terminal, such that a user may enter the unique key into their mobile phone such that the application server is able to pair the multimedia terminal and the mobile phone.
Preferably, the method further comprises, receiving, via. an input device of the mobile communication device, user selection data representing user selection; and displaying, using the display device, further multimedia data in accordance with the user selection data.
Advantageously, the method is adapted for allowing users to use their mobile phones in a similar manner as to a remote control device wherein, one or more options displayed by the mobile communication device for selection by the user. In this manner, the user may control the display of content of the multimedia terminal .
Preferably, the method further comprises receiving image capture request data representing an image capture request from the mobile communication device, and capturing image data, using an image capture device of the multimedia terminal.
Preferably, the method further comprises displaying the image data using the display device.
Preferably, the method further comprises sending the image data to the mobile communication device, and displaying the image data using the display device.
Preferably, the method further comprises displaying a video feed data from the image capture device using the display device and, upon receipt of the image capture request data, capturing image data from the video feed data.
Advantageously, the method is adapted for allowing users to capture image data from an image capture device of the multimedia terminal. In this manner, users may pose tor photos for capture and display by the multimedia terminal. Preferably, the method further comprises receiving further interaction request data representing a further interaction request from a further mobile comnrs.mica.tion device; aim displaying, using the display device of a multimedia terminal, the multimedia data further in response to the interaction request data.
Advantages, the method is adapted for allowing multiple user interaction with the multimedia terminal.
According to another aspect there is provided an application server for facilitating the display of interactive multimedia, the application server comprising: a. processor for processing digital data; and a memory device for storing digital data including computer program code and being coupled to the processor, a. network interface for sending md receiving digital data, across a data network, wherein the processor is controlled by the computer program code to: receive, via the network interface, interaction request data representing an interaction request from a mobile communication device; and send, via the network interface, multimedia data to a multimedia terminal representing multimedia in response to the interaction request data.
Preferably, the processor is further controlled by the computer program code to send, via the network interface, farther multimedia data to the mobile communication device.
Preferably, the processor is further controlled by the computer program code to identify the multimedia terminal from a. set of multimedia, terminals in accordance with the interaction request data.
Preferably, the interaction request data comprises nrultimedia terminal identification data representing the identity of the multimedia terminal and wherein the processor is further controlled by the computer program code to identify the multimedia terminal using the multimedia terminal identification data.
Preferably, the interaction request data comprises barcode scan image data representing a scan of a barcode.
Preferably, the barcode scan image data encodes a uniform resource locator.
Preferably, the processor is further controlled by the computer program code to send, via the network interface, barcode data representing the barcode.
Preferably, the processor is further controlled by the computer program code to send, via the network interface, further barcode data representing a further barcode after receipt of the interaction request data. Preferably, the processor is further controlled by the computer program code to send via the network interface, unique key data representing a key; receive, vra the network interface, input key data representing a.n input key; and identify the multimedia terminal from a set of multimedia terminals in accordance with the unique key data and the input key data.
Preferably, the processor is further controlled by the computer program code to receive, via the network interface, user selection data representing user selection; and send, via the net interface, further multimedia data in accordao.ee with the user selection data.
Preferably, the processor is further controlled by the computer program code to receive, via the network interface, image capture request data representing an image capture request, and receive, via the network interface, image capture data from m image capture device of the multimedia terminal.
Preferably, the processor is further controlled by the computer program code to send, via the network interface, the image data, for display by the display device.
Preferably, the processor is further controlled by the computer program code to send, via the network interface, the image data to the mobile communication device.
Preferably, the processor is farther controlled by the computer program code to receive, via the network interface, video feed data from the image capture device, and upon receipt of the image capture request data, capture image data from the video feed data.
Preferably, the processor is further controlled by the computer program code to receive, via the network interface, further interaction request data representing a further interaction request from a further mobile communication device; and display, using the display device of a multimedia terminal, the multimedia data further in response to the interaction request data.
According to auother aspect there is provided a mobile communication device for facilitating the display of interactive multimedia, the mobile communication device comprising a processor for processing digital data; and a memory device for storing digital data including computer program code and being coupled to the processor, a data scanning device for scanning digital data and being coupled to the processor, a network interface for sending and receiving digital data across a data network, wherein the processor is controlled by the computer program code to scars, using the data scanning device, multimedia terminal identification data from a data bearing device; send. Via the network interface, interaction request data representing an interaction request, wherein the interaction request data comprises the multimedia terminal identification data.
Preferably, the processor is further controlled by the computer program code to receive, via. the network interface, multimedia data. Preferably, the data scanning device comprises a barcode scanner, and wherein the multimedia terminal identification data is encoded in barcode image scan data.
Preferably, the barcode scan image data encodes a uniform resource locator.
Preferably, the processor is further controlled by the computer program code to send, via the network interface, the barcode scan image data.
Preferably, the data scanning device comprises a radiofrequency near field connm.mica.don device.
Preferably, the mobile communication device further comprises an input interface adapted for receiving user input and wherein the processor is further controlled, by the computer program code to receive, via the input interface, input key data representing an input key: send, via the network interlace, the input key data.
Preferably, the mobile communication device further comprises an input interlace adapted for receiving user input and wherein the processor is further controlled by the computer program code to receive, via the network interface, option data representing a set of options; receive, via the input interface, user selection data representing user selection from the set of options; and send, via the network interface, the user selection data.
Preferably, the mobile communication device further comprises an input interface adapted for receiving user input and wherein the processor is further controlled by the computer program code to receive, via the user input interface, image capture request data representing an image capture request, and send, via the network interface, the image capture request data.
Preferably, the processor is further controlled by the computer program code to receive, via the network interface, image data.
According to another aspect, there is provided a multimedia terminal for facilitating the display of interactive multimedia, the multimedia terminal comprising a processor for processing digital data.; and a memory device for storing digital data, including computer program code and being coupled to the processor, a display device for displaying digital data and being coupled to the processor, a network interface for sending and receiving digital data across a data network, wherein the processor is controlled by the computer program code to: display, using the display device, multimedia terminal identification data representing the identification of the multimedia terminal; receive, via the network interface, multimedia data representing multimedia from the application server, the multimedia data is selected in accordance with an interaction request: and display, using the display device, the multimedia data. Preferably, the multimedia terminal identification data comprises barcode data representing a barcode.
Preferably, the barcode data encodes a uniform resource locator.
Preferably, the multimedia terminal further composes an image capture device adapted for capturing image data and being coupled to the processor, wherein the processor is further controlled by the computer program code to receive, via the network interface, image capture request data representing an image capture request, and capture, using image capture device, image data. Other aspects of the invention am also disclosed.
Brief Description of the Drawings
Notwithstanding any other forms winch may tall within the scope of the present invention, preferred embodiments of the invention will now be described, by way of example only, with reference to the accompanying drawings in which:
Pig. 1 shows a computing device on which the various embodiments described herein may be implemented in accordance with an embodiment of the present invention;
Fig. 2 shows a network of computing devices on which the various embodiments described herein may be implemented in accordance with an embodiment of the present Invention;
Fig, 3 shows a method for displaying interactive multimedia in accordance with a preferred embodiment of the present invention; and
Pigs. 4 to 6 show exemplary graphical user interfaces of a multimedia terminal and communication device in the display of interactive multimedia in accordance with another embodiment of the present invention.
Description of Embodiments ft should be noted in the following description that like or the same reference numerals in different embodiments denote the same or similar features.
Computing device
Fig. 1 shows a computing device 100 on which the vanous embodiments described herein may be implemented, ft should be noted that the computing device 100 may take on differing configurations in the implementation of displaying interactive multimedia. For example, the computing device 100 may take the form of a mobile communication device, application server, multimedia terminal and the like. Furthermore, the steps of the method of displaying interactive multimedia described below may be implemented as computer program code instructions executable by one or more computing devices 100. The computer program code instructions may be divided into one or more computer program code instruction libraries, such as dynamic link libraries (DLL), wherein each of the libraries performs a one or more steps of the method. Additionally, a subset of the one or more of the libraries may perform graphical user interface tasks relating to the steps of the method.
The device 100 comprises semiconductor memory 1 10 comprising volatile memory such as random access memory (RAM ) or read only memory (ROM ). The memory 100 may comprise either RAM or ROM or a combination of RAM and ROM.
The device 100 comprises a computer program code storage medium reader 130 for reading the computer program code instructions from computer program code storage media 120. The storage media 120 may be optical media such as CD-ROM disks, magnetic media such as floppy disks and tape cassettes or flash media such as USB memory sticks.
The device further comprises I/O interface 140 for communicating with one or more peripheral devices. The I/O interface 140 may offer both serial and parallel interface connectivity. For example, the I/O interface 140 may comprise a Small Computer System interface (SCSI), Universal Serial Bus (USB) or similar I/O interface for interfacing with the storage medium reader 130. The I/O interface 140 may also communicate with one or more human, input devices (HID) 160 such as keyboards, pointing devices, joysticks and the like. The I/O interface 140 may also compose a. computer to computer interface, such as a. Recommended. Standard 232 (RS-232) interface, for interfacing the device 100 with one or more personal computer (PC) devices 190. The I/O interface 140 may also comprise an audio interface for communicate audio signals to one or more audio devices 1050, such as a speaker or a buzzer.
The device 100 also comprises a network interface 170 for communicating with one or more computer networks 180, The network 1 80 may be a wired network, such as a wired Ethernet iiVi network or a wireless network, such as a Bluetooth lU network or IEEE 802.11 network. The network 180 may be a local area network (CAN), such as a home or office computer network, or a wide area network (WAN), such as the Internet or private WAN,
The device 100 comprises an arithmetic logic unit or processor 1000 for performing the computer program code instructions. The processor 1000 may be a reduced instruction set computer (RISC) or complex instruction set computer (CISC) processor or the like. The device 100 further comprises a storage device 1030, such as a magnetic disk hard drive or a solid state disk dnve. Computer program code instructions may be loaded into the storage device 1030 from the storage media 120 using the storage medium reader 130 or from the network 180 using network interface 170. During the bootstrap phase, an operating system and one or more software applications are loaded from the storage device 1030 into the memory 1 10, During the fetch- decode-execnte cycle, the processor 1000 fetches computer program code instructions from memory 1 10, decodes the instructions into machine code, executes the instructions and stores one or more intermediate results in memory 100. in tins manner, the instructions stored in the memory 110, when retrieved and executed by the processor 1000, may configure the computing device 100 as a special -purpose machine that may perform the functions described herein.
'The device 100 also comprises a video interface 1010 for conveying video signals to a display device 1020, such as a liquid crystal display (LCD), cathode-ray tube (CRT) or similar display device.
The computing device 100 further comprises an image capture device 105 for capturing image arsd video data. As will be apparent from the below description, the computing device 100 ideally comprises the image capture device 105 when the computing device 100 is configured as a multimedia terminal so as to image capture and video data for the purposes of incorporation into the dynamic multimedia content.
The device 100 also comprises a communication bus subsystem 150 for interconnecting the various devices described above. The bus subsystem 150 may offer parallel connectivity such as industry Standard Architecture (ISA), conventional Peripheral Component Interconnect (PCI) and the like or serial connectivity such as PCI Express (PCle), Serial Advanced Technology Attachment (Serial ATA) aixl the like.
Network of computing devices
Fig. 2 shows a network 200 of computing devices 100 on which the various embodiments described herein may be implemented.
The network 200 comprises at least one multimedia terminal 205. The multimedia terminal 205 is used for displaying interactive multimedia in the manner described herein. The multimedia terminal 205 may take on different forms depending on the application but in a preferred embodiment, the multimedia terminal 205 comprises a display device 1020 such as an LCD or plasma display device. Generally, the multimedia terminal would be located in public allowing members of the public to interact with the multimedia terminal 205. For example, the multimedia terminal 205 may be fastened to a wall, stand or the like in a shopping centre and having a large display device 1020 for display multimedia content. Generally, the multimedia content relates to advertising goods or services but this need not necessarily be the case. For example, the multimedia content may relate to navigation thereby allowing a shopper to find a particular store in an interactive manner as described herein.
In one embodiment, the multimedia terminal 205 comprises an image capture device 105. The image capture device 105 may be located at an edge of the display device 1020 tor the purposes of capturing image and video data in the manner described herein.
The network further comprises at least one mobile communication device 210, such as a mobile phone, portable computer and the like. The mobile communication device 210 farther comprises a. display device 1020 tor displaying information to the user.
The network 200 further comprises a data network 180, described in the embodiment given as the Internet 230, As is apparent, the mobile communication device 210 is m communication with the multimedia terminal 205 across the Internet 230. In this manner, the multimedia terminal 205 and the mobile communication device 210 co-operate so as to allow the display of interactive multimedia content by the multimedia terminal 205.
In one embodiment, the network 200 comprises an application server 235. The application server 235 may marshal communication between the mobile communication device 210 and the multimedia terminal 205, The application server 235 may comprise a database for storing digital information including multimedia content. It should be noted in one embodiment that the multimedia terminal 205 may comprise an application server 235 responses to requests from the mobile communication device 210 such feat no externally located application server 235 is required. in one embodiment, the application server 235 takes the form of a web server, wherein the multimedia terminal 205 and the mobile conroiunicadon device 210 execute a browser application for the purposes of sending and receiving HTML requests and rendering HTML data, in tins manner, the application server 235 is provided with a web server application for receiving requests, such as Hypertext Transfer Protocol (HTTP) and File Transfer Protocol (FTP) requests, and serving hypertext web pages or files in response. The web server application may be, for example the Apache " or the Microsoft ,¾4 IIS HTTP server. The application server 235 is also provided with a hypertext preprocessor for processing one or more web page templates and data from one or more databases to generate hypertext web pages. The hypertext preprocessor may, for example, be the PHP: Hypertext Preprocessor (PHP) or Microsoft Asp s M hypertext preprocessor. The application server 235 is also provided with web page templates, such as one or more PHP or ASP files. Upon receiving a request from the web server application, the hypertext preprocessor is operable to retrieve a web page template, from the web page templates, execute my dynamic content therein, including updating or loading information from the one or more databases, to compose a hypertext web page. The composed hypertext web page may comprise client side code, such as Javascript, for Document Object Model (DOM) manipulating, asynchronous HTTP requests and the like. in this embodiment, the mobile communication device 210 and the multimedia terminal are provided with a browser application, such as the Moxiila Firefox'"" or Microsoft Internet Explorer'*' browser applications. The browser application requests hypertext web pages from the application server 235 and renders the hypertext web pages on a display device 1020.
Computer implemented method for displaying interactive multimedia.
Fig. 3 shows a computer implemented method 300 for displaying interactive multimedia. The method 300 is executed by one or more computing devices 100 and in particular one or more computing devices 100 connected across the Internet 230 as substantially shown in Fig. 2.
The method 300 starts at step 305 with the application server 235 receives interaction request data representing an interaction request from the mobile communication device 210.
Referring now to figure 4, there is shown an exemplary embodiment of the multimedia terminal 205, As is apparent from the embodiments given, the multimedia terminal 205 displays advertising information 482 a company. As such, the most media terminal 205 may be located within a shopping centre, for example. As is apparent from the embodiment given in figure 4, the multimedia terminal 205 comprises an image capture device 105 for capturing image and video data in the manner described further below.
Referring now to the lower portion of the display 1020 of the multimedia terminal there is shown a 2D barcode 405 accompanied by instructions "snap to interact". As will become apparent from the description below, the barcode 405 is scanned by the mobile communication device 210 to initiate interaction with the multimedia terminal 205.
For example, and it is apparent from the embodiments given, the multimedia terminal 205 poses the question "where would you like to go today?" As such, a shopper may be interested in embarking on a luxury tour to a foreign destination and will therefore use their mobile communication device 210 to interact with a multimedia terminal 205 to find out more information about the available luxury tours. In the embodiments were barcode 405 is used, the barcode 405 may encode a URL, wherein the URL composes multimedia terminal, identification data. For example, the URL that may be encoded by the barcode 405 may be: h hp :// w w w .redpropagan da, com .an/di splay i d:::: 145
As is apparent from the above exemplary URL, the URL encodes a unique multimedia terminal identification number 145, As will become apparent from the below description, the application server 235 will use this unique multimedia terminal identification number 145 to identify the correct multimedia terminal for which to display the interactive multimedia.
As such, the method 300 progresses to step 305 where the application server identifies the display device from a set of display devices in accordance with the interaction request data.
In one embodiment, the application server 235 database comprises a lookup table of the media terminals 205 such that the application server 235 may send the multimedia content to the appropriate multimedia terminal 205. in the embodiment where HTML is used, it is generally not possible to push multimedia content to the multimedia terminal 205 from the application server 235 upon receipt of an interaction request, in order to overcome this, the multimedia content of the multimedia terminal 205 may comprise client side scripting such as JavaScript for the purposes of periodically polling die application server 235 to ascertain an interaction request. in summary, where a user operates their mobile communication device 210 to scan the barcode 405, the browser application of the mobile communication device 210 may browse to the URL encoded by the barcode 405. The URL points to the application server 235 such that the application server 235 receives the HTM L GET request from the mobile communication device 210 comprising the unique identification of the multimedia terminal 205. The application server 235 then updates the database or session variable to indicate that an interaction request is pending for the multimedia terminal 205. The multimedia terminal 205 then sends an asynchronous poll to the application server 235 to ascertain the existence of an interaction request. As the application server 235 is m possession of an interaction request, the multimedia terminal 205 may then begin interacting with the user. in one simple embodiment, the browser application of the multimedia terminal 205 may be adapted to periodically refresh. At each refresh the application server 235 is simply adapted to serve the same webpages such that the display appears static to the user. However, after receipt of an interaction request from the mobile communication device 210, the application server 235, upon receipt of the refresh request from the multimedia terminal 205 may then be adapted to serve s.n alternate web page.
As such, at step 315 of method 300, the multimedia terminal 210 is adapted for displaying, using the display device 1020 of a multimedia terminal 210, multimedia data representing multimedia in response to the interaction request data..
It should be noted thai while a barcode 405 is described herein as the preferred embodiments for allowing a user to initiate the interaction with the multimedia terminal 210, other mechanisms may be adapted for allowing a user to initiate the interaction. For example, a near field communication (NFC) tag may be located at the multimedia terminal 205. hi this manner, the user's mobile communication device 210 having a NFC reader may simply swipe the mobile communication device 210 over the NFC tag to read the data encoded wiihm the NFC tag. In this manner, the NFC tag may encode the URL data described above such that the mobile communication device 210 may browse to the application server 235.
Referring now to the exemplary embodiments given in figure 5, there is shown the state of the multimedia terminal 205 aim the mobile communication device 210 at the initiation of interaction. As is apparent, the display device 1020 of the multimedia terminal 205 now displays a series of options available to the user. Specifically, in the embodiment given, the multimedia terminal 205 comprises three options comprising option A for Spam, option B for Cape Ibwn and option C for Sydney.
It should be noted that in the embodiment where HTML is used, as the mobile communication device 210 essentially browses to the application server 235, the mobile communication device 210 will also receive HTML content for rendering back from the application server 235. As such, as is apparent from the embodiment given, the mobile communication device 210 similarly displays of the three options for the user selection. The options available for selection may be HTML hyperlinks such that the user need simply select the appropriate hyperlink to send the user preference back to the application server 235,
For example, the user having clicked on the hyperlink for Spain, the mobile communication device 210 would send an action request to be application server 235 comprising the option fur Spain, whereafter the application server 235 may then be adapted to serve webpages relating to Spain at the next refresh request from the multimedia terminal 205.
In one embodiment, the application server 235 is adapted to allow two or more users to interact with the multimedia terminal 205. In this maimer, they first user may scan the barcode 405 and a second user may also scan the same barcode 405, wherein the application server 235 initiates separate sessions for each interaction reqnest. In an alternative embodiment, the application server 235 is adapted to serve md updated webpage to the mobile terminal 205 composing a differing barcode 405. In this manner, onee a barcode 405 has been "used" to reqnest an interaction, a further "new" barcode 405 may be displayed for a next scan.
In certain embodiments, it may not be possible to identify the specific multimedia terminal 205 from the interaction request data. For example, the display device 1020 of the multimedia terminal 205 may simply comprise a URL to winch users may manually browse. However, upon receipt of the HTTP requests for the URL, the application server 235 may not know which is the applicable multimedia terminal 205, As such, in this embodiment, the application server 235 may be adapted to display a unique key, such as a four digit pin on multiple multimedia terminals 205 wherein a unique four digit pin is displayed on each multimedia terminal. For example, in a first multimedia terminal 205a there may be displayed the four digit pin "1235" and on a second multimedia terminal 205b there may be displayed another four digit and "7419". The user is then instructed to input the four digit pin into their mobile communication device 210, Upon receipt of the four digit pin, the application server 235 is then able to ascertain which multimedia terminal 205 is the appropriate multimedia terminal tor display of the multimedia content.
Referring now to a preferred embodiment shown in figure 6, the system 200 is adapted to allow a user to image capture or video data. Specifically, as alluded to above, the multimedia terminal 205 comprises an image capture device 105. In use, the image capture device 105 may be adapted to image capture data from the image capture device 105 for display on the display device 1020 of the multimedia terminal 205. The image data captured from the image capture device may additionally be displayed on the display device 1020 of the mobile communication device 210. Suitable client side scripting such as Macromedia Flash may be used for the purposes of capturing image data.
In the example given in figure 6, the multimedia terminal 205 displays image data 605 representing the image data captured from the field of view of image capture device 105, As is apparent from the image data 605, four persons are standing in front of the multimedia terminal 205. Referring now to the mobile communication device 210, the display device 1020 of the mobile communication device 210 ftrriher displays the image data 605 in one embodiment. The mobile communication device 210 also allows the user to take a photo by the provision of a hyperlink labelled "take photo". In a preferred embodiment, the video data is shown by the display device 1020 of the multimedia terminal 205 such that the user's may pose and wherem, after having selected the "take photo" hyperlink, the multimedia terminal 205 is adapted to capture the image data from the video data.
In certain embodiments various advertising material overlay may be applied to the image data, such as the logo for lifetime tours arm the like. Furthermore, an adjacent printing device may be on hand for printing any captured image data.
Exemplary embodiment - airport muUimedia download
An exemplary embodiment will now be provided with reference to an application for the embodiments described herein with reference to use in the example of allowing air passengers to download multimedia prior to boarding an airplane. It should be noted that the embodiments provided in these exemplary embodiments are exemplary only and no technical limitations should be imputed to the embodiments described herein in accordance with these exemplary applications, in this exemplary embodiment, as will become apparent from the description below, air passengers may download multimedia prior to boarding an. airplane, such as entertainment multimedia such as mask, videos, electronic books and the like downloaded from a multimedia store such, as the Apple*** iTunesm or Google'** P!ay!&¾ store.
As such, upon arriving at check-in, passengers may view advertising material located at various locations advertising the fact that the air passengers should look out for interactive multimedia display devices.
As such, once having progressed through check-in, the user may view a multimedia terminal 205 taking the form of an electronic display board, such as electronic display board comprising a plurality of plasma, LCD or other digital display devices 1020 arranged together to form the electronic display board, so as to, for example provide a display board of 4 m in width and 1.5 m in height.
The display device 1020 or multimedia terminal 205 will display a suitable instruction to encourage the air passenger to interact with the multimedia terminal 205, such as "snap to interact", "swipe me" or the like. In this manner, adjacent the multimedia terminal 205, or displayed by the display device 1020 itself may be displayed a 2D barcode (encoding a URL in one embodiment as described above). As also described above, in one embodiment there would be a NFC/RFID tag or the like arranged next to the display device 1020,
In this manner, having scanned the barcode, or swiped the tag, the browser 215 of the user's mobile communication device 210 will browse to the URL encoded by the 2D barcode or NFC tag. Having received the HTTP request the application server 235 is able to identify the multimedia terminal 205 accordingly so as to update the display device 1020 of the appropriate multimedia terminal 205 accordingly.
For example, having scanned the 2-D barcode or swiped the NFC tag adjacent the multimedia terminal 205, the display device 1020 of the multimedia terminal 205 may display information such as "connecting... and then render a new HTML page or the like. in this example, the display device 1020 will display a plurality of multimedia entertainment items winch may be downloaded by the passenger. Simultaneously, the multimedia entertainment items would be displayed by the display device 1020 of the mobile communication device 210. For example, a plurality of electronic books may be displayed to the passenger.
Should the passenger, using the touch sensitive display device 1020 of the mobile communication device 210 swipe left or right, additional electronic books may be displayed by scrolling introduction from the left or the right hand side of the display device 1020 of the mobile communication device 210.
Simultaneously the gestures of the passenger would be replicated by the display device 1020 of the multimedia terminal 205. in this manner, each gesture performed by the user using the mobile communication device 210 may be relayed to the application server 235 via standard HTTP request, such as a page refresh request, Ajax request or the like. In this manner, the application server 235 is able to ascertain the user's gesture from the HTTP requests so as to update the display device 1020 of the multimedia terminal 205 accordingly. It should be noted that the application server 235 may be co-located with the multimedia terminal 205 and provided with a static IP address so as to be able to serve a web resource such that the mobile communication devices 210 may send HTTP requests directly to the application server 235 of the multimedia terminal 205,
Should a passenger be interacting with the multimedia terminal 205, and a further passenger also interact with the multimedia terminal 205, the multimedia terminal 205 may be adapted such that the display device 1020 splits into two separate session portion displays allowing each passenger to separately interact with the multimedia terminal 205. In alternative embodiments, as opposed to splitting the display, the multimedia terminal 205 may allow multiple users to interact simultaneously so as to, using this example, simultaneously interact in the selection of multimedia content for download. In alternative embodiments, it can be appreciated that other user interaction may be afforded, such as by allowing multiple users to play interactive games, such as the retro arcade style game "pong" where each player controls a respective paddle or the bke. Then, once the passenger decides on a par ocular electronic book, the passenger may select the electronic book for purchase. The browser 215 of the mobile communication device 210 may then redirect to appropriate software application of the passengers mobile communication device 210 or a payment processing webpage so as to allow the passenger to complete the purchase and so as to end the passenger's session with the multimedia terminal 205.
In certain embodiments, the mobile communication device 210 of tbe passenger may have stored in the URL associated, with the multimedia terminal 205 in cache. As such, so as to prevent the inadvertent controlling of the multimedia terminal 205 while the passenger is not physically present at the multimedia terminal, the multimedia terminal 205 may be adapted to display a physical presence challenge, such as displaying a code for entry by the passenger to verify that the passenger is proximate the multimedia terminal 205, In other embodiments, the location information may be sent by the mobile communication device 210 so as to satisfy the application server 235 that the passenger is actually present at the multimedia terminal 205. Such location information may be obtained from the Wi-Fi hotspot for example or alternatively the GPS or other location mechanism of tbe user's mobile can indication device 210,
Exemplary embodiment - boardroom software
In a further exemplary embodiment, the embodiments described herein may be suited for use in boardrooms where a presenter may utilise their mobile communication device 210 for the purposes of controlling the presentation. Such an embodiment is especially suited for Web-based presentation software and the like where a presentation is served by a. Web server such as by usmg HML, Adobe Flash or the like.
In this manner, the presenter may use the presenter's mobile communication device to control the flow of the presentation. in initiating the presentation, and NFC tag or the like may be located at a suitable location, such as at the centre of the boardroom table. In this manner, the presenter may simply swipe the presenter's mobile communication device 215 over the NFC tag such that the appropriate presentation is displayed by the display device 1020 of the multimedia terminal 205.
Then, the mobile communication device 210 of the present and may display appropriate control icons, such as backwards, forwards and the like. In this manner, using the controls, the presenter may control the flow of the presentation.
In one embodiment, so as to negate the need for the presented to authenticate with the application server 235 upon initiating each presentation by scanning the 2-13 barcode or swrpmg the NSC tag, in one embodiment, tbe mobile communication device 210 of the present and may be adapted to store session information, such as by way of a cookie or the like such that dining a predeiemvined session period the presenter may reinitiates the presentation.
Interpretation
In the context of this document, the term "bus" and its derivatives, while being described in a preferred embodiment as being a communication bus subsystem for interconnecting various devices including by way of parallel connectivity such as Industry Standard Architecture (ISA), conventional Peripheral Component Interconnect (PCI) and the like or serial connectivity such as PCI Express (PCIe), Serial Advanced Technology Attachment (Serial ATA) and the like, should be construed broadly herein as any system for communicating data.
In aa'OruO'U e with:
As described herein, tin accordance with' may also mean 'as a function of and is not necessarily limited to the integers specified In relation thereto.
C¾mpasr:¾e Hem-.
As described herem, 'a computer implemented method' should not necessarily be inferred as being performed by a single computing device such that the steps of the method may be performed by more than one cooperating computing devices.
Similarly objects as used herem such as 'web server', "server', 'client computing device', 'computer readable medium' and the like should not necessarily be construed as being a single object, and may be implemented as a two or more objects in cooperation, such as, for example, a web server being construed as two or more web servers in a server farm cooperating to achieve a desired goal or a computer readable medium being distributed in a composite manner, such as program code being provided on a compact disk activatable by a license key downloadable from a. computer network.
Database:
In the context of this document, the term "database" and its derivatives may be used to describe a single database, a set of databases, a system of databases or the like. The system of databases may comprise a set of databases wherein the set of databases may be stored on a single implementation or span across multiple implementations. The term "database" is also not limited to refer to a certain database forrnat rather may refer to any database format. For example, database formats may include MySQL, MySQL! , XML or the like. Wireless:
The invention may be embodied using devices conforming to other network standards and for other applications, including, for example other WLAN standards and other wireless standards. Applications that can be accommodated include IEEE 802.11 wireless LANs and links, and wrreless Ethernet.
In the context of this document, the term "wireless'5 and its derivatives may be used to describe circuits, devices, systems, methods, techniques, communications channels, etc, that may communicate data, through the use of modulated electromagnetic radiation through a non-solid medium. The term does not imply that the associated devices do not contain any wires, although in some embodiments they might not. In the context of this document, the term "wired" and its derivatives may be vised to describe circuits, devices, systems, methods, techniques, communications channels, etc., that may communicate data through the use of modulated electromagnetic radiation through a solid medium. The term does not imply that the associated devices are coupled by electrically conductive wires.
.Proca^esv
Unless specifically stated otherwise, as apparent from the following discussions, it is appreciated that throughout the specification discussions utilizing terms such as "processing", "computing", "calculating", "determining", "analysing" or the like, refer to the action and/or processes of a. computer or computing system, or similar electronic computing device, that manipulate and/or transform data represented as physical, such as electronic, quantities into other data similarly represented as physical quantities.
Processor:
In a similar manner, the term "processor" may refer to any device or portion of a device that processes electronic data, eg , from registers and/or memory to transform that electronic data into other electronic data that, e.g., may be stored in registers and/or memory. A "computer" or a. "computing device" or a "computing machine" or a "computing platform" may include one or more processors.
The methodologies described herein are, in one embodiment, performable by one or more processors that accept computer-readable (also called machine-readable) code containing a set of instructions that when executed by one or more of the processors carry out at least one of the methods described herein. Any processor capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken are included. Thus, one example is a typical processing system that includes one or more processors. The processing system further may include a memory subsystem including mam RAM and/or a static RAM, and/or ROM,
ComptUer-Readahle Medium:
Furthermore, a computer-readable earner medium may form, or be included in a computer program product, A computer program product ca.n be stored on a computer usable carrier medium, the computer program product comprising a computer readable program means for causing a processor to perform a method as described herein.
Networked or Multiple Processors:
In alternative embodiments, the one or more processors operate as a standalone device or may be connected, e.g., networked to other processors), in a networked deployment, the one or more processors may operate in the capacity of a server or a client machine in server-client network environment, or as a peer machine in a peer-to-peer or distributed network environment. The one or more processors may form a web appliars.ee, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
Note that while some diagram(s) only show(s) a single processor and a single memory that carries the computer-readable code, those in the art will -understand that many of the components described above are included, but not explicitly shown or described in order not to obscure the inventive aspect. For example, while only a single machine is ilmstraied, the term "machine" straii also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
Additional Embodiments:
Thus, one &mho&rmni of each of the methods described herein is in the form of a computer- readable carrier medium carrying a set of instructions, e.g., a computer program that are for execution on one or more processors. Thus, as will be appreciated by those skilled in the art, embodiments of the present invention may be embodied as a method, an apparatus such as a special purpose apparatus, au apparatus such as a data processing system, or a computer-readable carrier medium. The computer-readable carrier medium carries computer readable code including a set of instructions that when executed on one or more processors cause a processor or processors to implement a method. Accordingly, aspects of the present invention may take the form of a method, an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of carrier medium (e.g., a computer program product on a computer-readable storage medium) carrying computer-Tearlable program code embodied in the medium.
Cm tier Medium;
The software may further be transmitted or received over a network via a network interface device. While tbe carrier medium is shown in an example embodiment to be a single medium, tbe term "carrier medium" should be taken to include a single medium or multiple media (e.g., a centralized or distribu ted database, a rubor associated cacbes and servers) tbat store the one or more sets of instructions. The term "carrier medium" shall also be taken to include any medium that is capable of storing, encoding or carrying a set of instructions for execution by one or more of the processors and that cause the one or more processors to perform any one or more of the methodologies of the present invention. A carrier medium may take many forms, including but not limited to, non- volatile media, volatile media, aud transmission media.
Implementation: it will be understood that the steps of methods discussed are performed in one embodiment by an appropriate processor (or processors) of a processing (i.e., computer) system executing instructions (computer-readable code) stored in storage. It will also be understood that the indention is not limited to any particular implementation or programming technique aud that tbe invention may be implemented using any appropriate techniques for implementing the functionality described herein. The invention is not limited to any particular programming language or operating system.
Means For Carrying out a Method or Function
Furthermore, some of the embodiments are described herein as a method or combination of elements of a method that cars be implemented by a processor of a processor device, computer system, or by other means of carrying out tbe function. Thus, a processor with the necessary instructions for carrying out such a method or element of a method forms a means for carrying out tbe method or element of a method. Furthermore, an element described herein of an apparatus embodiment is an example of a means for carrying out the function performed by tbe element for the purpose of carrying out the invention.
Similarly, it is to be noticed that tbe term connected, when used in the claims, should not be interpreted as being limitative to direct connections only. Thus, the scope of the expression a device A connected to a device B should not be limited to devices or systems wherein an output of device A is directly connected to an input of device B. It means that there exists a path between an output of A and an input of B which may be a path including other devices or means. "Connected" may mean that two or more elements are either in direct physical or electrical contact or that two or more elements are not in direct contact with each other but yet still cooperate or interact with each other.
Embodiments:
Reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases "m one embodiment" or "in an embodiment" in varions places throughout this specification are not necessarily all referring to the same embodiment, but may. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner, as wonld be apparent to one of ordinary skill in the art from this disclosure, in one or more embodiments.
Similarly it should be appreciated that in the above description of example embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description of Specific Embodiments are hereby expressly incorporated into tins Detailed Description of Specific Embodiments, with each claim standing on its own as a separate embodiment of this invention.
Furthermore, while some embodiments described herein include some but not other features included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the invention, and form different embodiments, as would be understood by those in the art. For example, in the following claims, any of the claimed embodiments can be used in any combination.
Specific Details in the description provided herein, numerous specific details are set forth. However, It is understood that embodiments of the invention may be practiced without these specific details. In other instances, well-known methods, structures and techniques have not been shown iu detail in order not to obscure an -understanding of this description. Terminology in describing the preferred embodiment of tbe invention illustrated in tbe drawings, specific terminology will be resorted to for the sake of clarity. However, the invention is not intended to be limited to the specific terms so selected, and it is to be understood that each specific term includes all technical equivalents which operate in a similar manner to accomplish a similar technical purpose. Terms such as n forward", "rearward", "radially", "peripherally", "upwardly", "downwardly", and the like are used as words of convenience to provide reference points and axe not to be construed as limiting terms.
Different Instances of Objects
As used herein, unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially. In ranking, or in any other manner.
Comprising and Including
In the claims which follow and in tbe preceding description of the invention, except where the context requires otherwise due to express language or necessary implication, the word "comprise" or variations such as "comprises" or "composing" are used m an inclusive sense, i.e. to specify the presence of the stated features but not to preclude tbe presence or addition of further features in various embodiments of the invention.
Any one of the terms: including or which includes or that includes as used herein is also an open term that also means including at least tbe elements/features that follow the term, but not excluding others, Tims, including is synonymous with and means composing.
Scope of Invention
Thus, while there has been described what are believed to be the preferred embodiments of the invention, those skilled In the art will recognize that other and further modifications may be made thereto without departing from the spirit of tbe invention, and it is intended to claim all such changes and modifications as fall within the scope of the invention. For example, any formulas given above are merely representative of procedures that may be used. Functionality may be added or deleted from the block diagrams and operations may be interchanged among functional blocks. Steps may be added or deleted to methods described within the scope of the present invention. Although the invention has been described with reference to specific examples, it will be appreciated by those skilled in the art that the invention may be embodied in many other forms.
Industrial Applicability
It is apparent from the above, that the arrangements described are applicable to the interactive multimedia industries.

Claims

Claims
1. A method for displaying interactive multimedia,, the method comprising:
receiving interaction request data representing an interaction request from a mobile communication device: and
displaying, using a display device of a multimedia terminal, multimedia data representing multimedia in response to the interaction request data.
2. A method as claimed in claim L further comprising displaying further multimedia data using a displ ay device of the mobile communication device.
3. A method as claimed in claim 1, farther comprising identifying the multimedia terminal from a set of multimedia terminals in accordance with the interaction request data,
4. A method as claimed in claim 1 , wherein the interaction request data comprises multimedia terminal identification data representing the identity of the multimedia terminal and wherein the method further comprises identifying the multimedia terminal using the multimedia terminal identification data.
5. A method as claimed in claim 4, wherein the interaction request data comprises barcode scan image data representing a scan of a barcode.
6. A method as claimed in claim 5, wherein the barcode scan image data encodes a -uniform resource locator.
7. A method as claimed in claim 5, further comprising displaying, using the display device, the barcode.
8. A method as claimed in claim 7, further comprising displaying, using the display device, a further barcode after receipt of the interaction request data.
9. A method as claimed in claim 1 , further comprising:
displaying, using the display device, unique key data representing a key;
receiving, from the mobile communication device, input key data representing an input key: and
identifying the multimedia terminal from a set of multimedia terminals in accordance with the unique key data and the input key data,
10. A method as claimed in claim 1 , further comprising:
receiving, via an input device of the mobile communication device, user sel ection data representing user selection; and
displaying, using the display device, further multimedia data in accordance with the user selection data.
1 1. A method as claimed in claim 1 , further comprising: receiving image capture request data representing an image capture request from the mobile communication device, and
capturing image data using an image capture device of the multimedia terminal
12, A method as claimed in claim 11, further comprising displaying the image data using the display device.
13, A method as claimed in claim 12, further comprising sending the image data to the mobile communication device, and displaying the image data using the display device.
14, A method as claimed in claim 1 i, further comprising displaying a video feed data from the image capture device using the display device and, upon receipt of the image capture request data, capturing image data from the video feed data,
1 5, A method as claimed in claim 1, further comprising:
receiving further interaction request data representing a further interaction request from a further mobile communication device; and
displaying, using the display device of a multimedia terminal, the multimedia data further in response to the interaction request data.
16, An application server for facilitating the display of interactive multimedia, the application server comprising:
a processor for processing digital data: and
a memory device for storing digital data including computer program code and being coupled to the processor,
a network interlace lor sending aixl receiving digital data across a data network, wherein the processor is controlled by the computer program code to:
receive, via the network interface, interaction request data representing an interaction request from a mobile communication device: and
send, via the network interface, multimedia data to a multimedia terminal representing multimedia in response to the interaction request data,
17. An application server as claimed in claim 16, wherein the processor is further controlled by the computer program code to send, via the network interface, further multimedia data to the mobile communication device.
18. An application server as claimed in claim 16, wherein the processor is further controlled by the computer program code to identify the multimedia terminal from a set of multimedia terminals in accordance with the interaction request data.
19. An application server as claimed in claim 16, wherein the interaction request data comprises multimedia terminal identification data, representing the identity of the multimedia terminal and wherein the processor is further controlled by the computer program code to identify the multimedia terminal using the multimedia terminal identification data.
20. An application server as claimed m claim 19, wherein the interaction request data comprises barcode scan image data representing a scan of a barcode,
21. An application server as claimed in claim 20, wherein the barcode scan image data encodes a uniform resource locator.
22. An application server as claimed in claim 20, wherein the processor is further controlled by the computer program code to send, via the network interface, barcode data representing the barcode.
23. An application server as claimed in claim 20, wherein the processor is further controlled by the computer program code to send, via the network interface, further barcode data representing a farther barcode after receipt of the interaction request data.
24. An application server as claimed in claim 16, wherein the processor is further controlled by the computer program code to:
send via the network interface, unique key data representing a key;
receive, via the network interface, input key data representing an input key; and identify the multimedia terminal from a set of multimedia terminals in accordance with the unique key data and the input key data.
25. An application server as claimed in claim 16, wherein the processor is farther controlled by the computer program code to:
receive, via the network interface, user selection data representing user selection; and send, via the net interface, further multimedia data in accordance with the user selection data,
26. An application server as claimed in claim 16, wherein the processor is farther controlled by the computer program code to:
receive, via the network interface, image capture request data representing an image capture request, and
receive, via the network Interface, image capture data from an image capture device of the multimedia terminal.
27. An application server as claimed, in claim 26, wherein the processor is further controlled by the computer program code to send, via the network interface, the image data for display by the display device.
28. An application server as claimed in claim 26, wherein the processor is further controlled by the computer program code to send, via the network interface, the image data to the mobile communication device.
29. An application server as claimed in claim 26, wherein the processor -s further controlled by the computer program code to:
receive, via the network interface, video feed data from the image capture device, and upon receipt of the image capture request data, capture image data from the video feed- data,
30. An application server as claimed in claim 16, wherein the processor is further controlled by the computer program code to:
receive, via the network interface, further interaction request data representing a further interaction request from a further mobile communication device; and
display, using the display device of a multimedia terminal, the multimedia data further m response to the interaction request data..
31 . A mobile communication device for facilitating the display of interactive
multimedia, the mobile communication device comprising:
a processor for processing digital data: and
a memory device for storing digital data including computer program code and being coupled to the processor,
a data scanning device for scanning digital data and being coupled to the processor, a network interface for sending and receiving digital data, across a data network, wherein the processor is controlled by the computer program code to:
scan, using the data scanning device, multimedia terminal identification data from a data bearing device;
send, via. the network interlace, interaction request data representing an interaction request, wherein the interaction request data composes the multimedia terminal identification data,
32. A mobile communication device as claimed in claim 31 , wherein the processor is further controlled by the computer program code to receive, via the network interface, multimedia data.
33. A mobile communication device as claimed in claim 31, wherein the data scanning device comprises a barcode scanner, and wherein the multimedia terminal identification data is encoded in barcode image scan data.
34. A mobile communication device as claimed, in claim 33, wherein the barcode scan image data encodes a uniform resource locator.
35. A mobile communication device as claimed in claim 33, wherein the processor is further controlled by the computer program code to send, via the network interface, the barcode scan image data.
36. A mobile communication device as claimed in claim 31 , wherein the data scanning device comprises a radiofreqaency near field communication device.
37. A mobile communication device as claimed m claim 1 6, further comprising an input: interface adapted for receiving user input and wherein the processor is further controlled by the computer program code to:
receive, via the input interface, input key data representing an input key;
send, via the network interface, the input key data.
38. A mobile communication device as claimed in claim 31 , further comprising an input interface adapted for receiving user input and wherein the processor is further controlled by the computer program code to:
receive, via the network interface, option data, representing a set of options;
receive, via the input interface, user selection data representing user selection from the set of options; and
send, via the network interface, the user selection data.
39. A mobile communication device as claimed in claim 31 further comprising an input interface adapted tor receiving user input and wherein the processor is further controlled by the computer program code to:
receive, via the user input interface, image capture request data representing an image capture request, and
send, via the network interface, the image capture request data.
40. A mobile communication device as claimed In claim 39, wherein the processor is further controlled by the computer program code to receive, via the network interface, image data,
41. A multimedia terminal for facilitating the display of interactive multimedia, the multimedia terminal comprising:
a processor for processing digital data; and
a memory device for storing digital data including computer program code and being coupled to the processor,
a display device tor displaying digital data and being coupled to the processor,
a network interface for sending and receiving digital data across a. data, network, wherein the processor is controlled by the computer program code to:
display, using the display device, multimedia terminal, identification data representing the identification of the multimedia terminal;
receive, via the network interlace, multimedia data representing multimedia from the application server, the multimedia data is selected in accordance with an interaction request; and display, using the display device, the multimedia data.
42, A multimedia terminal, as claimed in claim 41, wherein the multimedia terminal identification data comprises barcode data representing a barcode.
43, A multimedia terminal as claimed in claim 42, wherein the barcode data encodes a uniform resource locator.
44, A multimedia terminal as claimed in claim 41 further comprising an image capture device adapted for capturing image data and being coupled to the processor, wherein the processor is further controlled by the computer program code to:
receive, via the network interface, image capture request data representing s.n image capture request, and
capture, using image capture device, image data.
PCT/AU2013/000951 2012-08-27 2013-08-27 A method, application server, mobile communication device and multimedia terminal for displaying interactive multimedia WO2014032088A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
AU2012903687A AU2012903687A0 (en) 2012-08-27 A method, application server, mobile communication device and multimedia terminal for displaying interactive multimedia
AU2012903687 2012-08-27

Publications (1)

Publication Number Publication Date
WO2014032088A1 true WO2014032088A1 (en) 2014-03-06

Family

ID=50182249

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/AU2013/000951 WO2014032088A1 (en) 2012-08-27 2013-08-27 A method, application server, mobile communication device and multimedia terminal for displaying interactive multimedia

Country Status (1)

Country Link
WO (1) WO2014032088A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104601721A (en) * 2015-01-31 2015-05-06 华为技术有限公司 Multi-terminal information processing method and device
WO2015168580A1 (en) * 2014-05-01 2015-11-05 Google Inc. Computerized systems and methods for providing information related to displayed content
US20160117735A1 (en) * 2014-10-28 2016-04-28 Bryan Mongeau Method, digital signage server and computer program product for displaying mobile media content associated to a digital signage display unit
CN111275471A (en) * 2018-12-04 2020-06-12 北京海益同展信息科技有限公司 Information processing method, information presentation terminal, and storage medium
EP3737102A1 (en) * 2019-05-08 2020-11-11 Samsung Electronics Co., Ltd. Electronic apparatus, user terminal, and method of controlling the electronic apparatus and the user terminal

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070294096A1 (en) * 2004-11-04 2007-12-20 Stephen Randall System and Method for Interactive Marketing
US20080039063A1 (en) * 2006-05-19 2008-02-14 Seiko Epson Corporation Image display system, image display device of image display system, mobile terminal device, connection establishment method of image display system
WO2012158334A2 (en) * 2011-05-16 2012-11-22 Wesley Boudville Systems and methods for changing an electronic display that contains a barcode

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070294096A1 (en) * 2004-11-04 2007-12-20 Stephen Randall System and Method for Interactive Marketing
US20080039063A1 (en) * 2006-05-19 2008-02-14 Seiko Epson Corporation Image display system, image display device of image display system, mobile terminal device, connection establishment method of image display system
WO2012158334A2 (en) * 2011-05-16 2012-11-22 Wesley Boudville Systems and methods for changing an electronic display that contains a barcode

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015168580A1 (en) * 2014-05-01 2015-11-05 Google Inc. Computerized systems and methods for providing information related to displayed content
US20160117735A1 (en) * 2014-10-28 2016-04-28 Bryan Mongeau Method, digital signage server and computer program product for displaying mobile media content associated to a digital signage display unit
EP3016056A1 (en) * 2014-10-28 2016-05-04 BroadSign International LLC. Method, digital signage server and computer program product for displaying mobile media content associated to a digital signage display unit
CN104601721A (en) * 2015-01-31 2015-05-06 华为技术有限公司 Multi-terminal information processing method and device
CN111275471A (en) * 2018-12-04 2020-06-12 北京海益同展信息科技有限公司 Information processing method, information presentation terminal, and storage medium
EP3737102A1 (en) * 2019-05-08 2020-11-11 Samsung Electronics Co., Ltd. Electronic apparatus, user terminal, and method of controlling the electronic apparatus and the user terminal
US11589222B2 (en) 2019-05-08 2023-02-21 Samsung Electronics Co., Ltd. Electronic apparatus, user terminal, and method for controlling the electronic apparatus and the user terminal

Similar Documents

Publication Publication Date Title
US9489702B2 (en) Information processing device, data processing method thereof, and program
WO2014032088A1 (en) A method, application server, mobile communication device and multimedia terminal for displaying interactive multimedia
CN113420247A (en) Page display method and device, electronic equipment, storage medium and program product
CN106982240B (en) Information display method and device
JP2015509241A5 (en)
US20150120462A1 (en) Method And System For Pushing Merchandise Information
US9491368B2 (en) Information obtaining and viewing device, data processing method thereof, and non-transitory computer readable medium storing a program
CN103189864A (en) Methods and apparatuses for determining shared friends in images or videos
KR20150032711A (en) Peer-assisted shopping
CN107656768A (en) Control the method and its system of page jump
US20120226586A1 (en) Computer systems and methods for interactive shopping experience in retail stores
US9514718B2 (en) Information processing system, information processing apparatus, and information processing method
US20150186976A1 (en) Set sales processing system
CN112346594A (en) Interaction method and device based on augmented reality
US9390443B2 (en) Product information providing server apparatus, product information display program, product information display method, product information providing system, terminal device, and recording medium on which product information display program is recorded
US10318989B2 (en) Information providing method and system using signage device
US20160350299A1 (en) Image as database
KR101944812B1 (en) Apparatus for providing a content upload service between different sites and method thereof
CN110796509A (en) Commodity recommendation method and device
CN113747223B (en) Video comment method and device and electronic equipment
US10204372B1 (en) Systems and methods for facilitating enhanced device functionalities within a retail store
Di Rienzo et al. Bridging physical space and digital landscape to drive retail innovation
CN113077322A (en) Commodity information display method and device, storage medium and computer equipment
US20230208789A1 (en) Method and device for providing chat service in map-based virtual space
KR20160037332A (en) Method, system and recording medium for providing video contents and addition contents in social platform

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13833233

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13833233

Country of ref document: EP

Kind code of ref document: A1