CN103945274A - Method and equipment for providing interactive augmented reality information corresponding to television programs - Google Patents
Method and equipment for providing interactive augmented reality information corresponding to television programs Download PDFInfo
- Publication number
- CN103945274A CN103945274A CN201310689163.0A CN201310689163A CN103945274A CN 103945274 A CN103945274 A CN 103945274A CN 201310689163 A CN201310689163 A CN 201310689163A CN 103945274 A CN103945274 A CN 103945274A
- Authority
- CN
- China
- Prior art keywords
- content
- mobile device
- image
- server
- television
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses a plurality of technologies for displaying multimedia content based on augmented reality (AR). The AR content corresponds to a TV program shown on a television screen. One embodiment mode of the technologies does not require scanning any AR identifier or related image to search specified AR content. An AR system used for television broadcast program comprises a mobile device, a digital television or an Internet television, and a TV-AR management server based on cloud computing. The TV-AR management server is configured to provide correct AR content corresponding to a broadcasting program and a television program received by a television in the use by a user.
Description
[technical field]
The present invention relates generally to augmented reality field.Especially, the present invention relates to multiple for will strengthen accordingly realize the technology covering on image or the video just showing on television equipment.
[background technology]
Augmented reality (Augmented Reality, AR) is a kind of type of virtual reality, and its object is to copy the environment in the world in computer equipment.Augmented reality system generates composed view for user, and this view is the real scene watched of user and the combination that utilizes the virtual scene that the computer equipment of additional content enhanced scene generates.The virtual scene generating by computer equipment is designed to strengthen user for watching or the sensory perception of mutual virtual world.The object of augmented reality is to create a kind of user can not differentiate the system of the difference between real world and its virtual enhancing.Augmented reality of today is used in amusement, military training, engineering design, Robotics, manufacture and other industry.
The recent development of mobile device and cloud computing allows software developer to create a lot of AR application programs to cover virtual objects in the image being caught and/or additional 2D/3D multimedia messages.In order to show AR such as virtual objects content in the real screen area that shows true picture, user needs scan A R specific identifier (for example QR code) or is equal to the image of mark, thereby retrieves AR content by server.
For TV programme, implement AR and really exist some difficulties.Because user is conventionally sitting on sofa and watches video screen, so because the distance between video screen and beholder can produce variety of issue.In the time that AR mark is placed on video screen, in playing TV programme, can identify or the image that is equal to mark produces visual difficulty the correct detection AR relevant with this specific television program.Another problem is that Television Broadcasting Limited may not accept is only in order to realize for the AR function of TV programme and add continuous visual image in TV programme.TV programme equally also has the specific difficulty of implementing for AR.Due to possible natural calamity or other emergencies, the timetable of TV programme exists the intrinsic problem of variable situation aspect playing plan.Therefore, provide the technology of mutual augmented reality content also to have demand for the TV programme of playing.
[summary of the invention]
These chapters and sections have been summed up existing discloseder aspects, and simply introduce some preferred embodiments.The simplification of these chapters and sections or omission be the same with explanation in summary or title may avoid hiding the object of these chapters and sections, summary and title.These simplification or omission not want to limit existing scope of disclosure.
Usually, the present invention relates to multiplely for showing the technology of any multimedia messages based on augmented reality (AR) corresponding to the TV on video screen (TV) program, these technology do not need to scan any AR mark or associated picture to retrieve specific AR content.According to an aspect of the present invention, a kind of AR system for television program comprises mobile device, Digital Television or internet television and the TV-AR management server based on cloud computing.The TV programme that described TV-AR management server is configured to receive to the television set of broadcasting and just used by user simultaneously provides correct AR content.
According to performance, the present invention can be implemented to a part for method, equipment or system.According to an execution mode, it is used for providing the method for augmented reality (AR) content for one, the method comprises: receive the request from mobile device, in order to download AR content according to the image in the demonstration screen display of television equipment just, wherein said mobile device and described television equipment carry out radio communication with reception the details about the image showing on described television equipment; From database, search for suitable AR content according to the details about described image, wherein said suitable AR content is time synchronized with the image just showing on television equipment; And this suitable AR content is discharged into described mobile device, to show described AR content on described image.
According to another execution mode, it provides the method for augmented reality (AR) content for one, the method comprises: send request to server from mobile device, to obtain suitable AR content for covering described AR content on the image showing on the display screen of television equipment, wherein said mobile device and described television equipment carry out radio communication to receive the details about the image just showing on this television equipment; And on described image, show described suitable AR content.
One of object of the present invention, feature and advantage provide a lot of flexibilities for show corresponding AR content on the image showing on television equipment.The use of mobile device is the retrieval helping corresponding to the correct AR content of the TV programme just showing on television equipment.
Other targets of the present disclosure, advantage and advantage will become more obvious by ensuing preferred embodiment illustrating by reference to the accompanying drawings.
[brief description of the drawings]
In conjunction with ensuing explanation, claims, with reference to accompanying drawing, these and other features of the present invention, aspect and advantage will be easier to understand.
Figure 1A has described the configuration 100 according to an embodiment of the invention;
Figure 1B shows another execution mode, and wherein Television Broadcasting Limited has generated its oneself TV Guide or live plan in server (being called as the IEPG server of renewal here);
Fig. 1 C shows the functional block diagram of the TV channel for obtaining from television set to mobile device;
Fig. 2 A has described displaying SLAM algorithm and how to be used to the example of the 3D coordinate of determining television frame (screen);
Fig. 2 B and Fig. 2 C show respectively two examples in the AR content of the touch screen display of mobile device;
Fig. 3 shows the flow chart of the flow process 300 of implementing in the mode of default mode;
Fig. 4 A shows the corresponding data flow 400 between different server (as shown in Figure 1B), and wherein TV-AR management server is provided for single Television Broadcasting Limited;
Fig. 4 B and Fig. 4 C have described respectively linked database and the AR content data set of IEPG data set, correctly identify corresponding to the AR content of TV programme of being made when request by mobile device for Television Broadcasting Limited;
Fig. 4 D shows a kind of system configuration 450, for example, comprising mobile device, television equipment (conventional television or have the computing equipment of display screen) and for the TV-AR management server of multiple TV programme of being provided by different Television Broadcasting Limiteds;
Fig. 5 A and Fig. 5 B have described respectively the example user interface layout in the time that corresponding AR information shows on mobile device;
Fig. 6 shows a kind of configuration 600 that is modified to provide location-based TV-AR content;
Fig. 7 shows a kind of configuration of TV-AR server, so that spectators' TV-AR statistics to be provided to TV broadcasting service device.
[embodiment]
In the following description, for being provided, complete understanding of the present invention stated a large amount of details.But to those skilled in the art, the present invention obviously can implement in the situation that not having these details.The description here and statement are the common means that this area is experienced or those of ordinary skill uses, to more effectively express the essence of their work to others skilled in the art.In other examples, for fear of fuzzy each aspect of the present invention unnecessarily, so do not describe known method, flow process, assembly and circuit in detail.
Here " execution mode " or " execution mode " mean that the specific features relevant with this execution mode, structure or characteristic can be included at least one execution mode of the present invention.Phrase " in one embodiment " in the text appearance everywhere must not refer to same execution mode, and execution mode and other execution modes independent or that replace are not mutually exclusive yet.Further, the order that represents the square frame in flow chart or the chart of one or more execution modes of the present invention not represents any specific order, also non-hint any restriction of the present invention regularly.
Embodiments of the present invention are discussed in connection with Fig. 1-Fig. 7.But it is for task of explanation that those skilled in the art can easily understand the specific descriptions about these accompanying drawings given here, the scope of the invention exceedes these limited execution modes.
According to a kind of execution mode, TV Guide (for example internet electronic program guide (Internet Electronic Program Guide, synchronizeing IEPG)) and between the onboard clock of mobile device is used to this mobile device and for example, downloads corresponding AR content from private server (Cloud Server), and wherein said AR content is being broadcasted or TV programme that user is watching is mated exactly with current.
Figure 1A has described the configuration 100 according to an embodiment of the invention.The operating system (such as Google's Android operating system) of mobile device 102 and digital television 104 or internet television communicates by Wi-Fi direct-connected (Wi-Fi Direct) or such as other radio communications of Bluetooth protocol etc., to identify the television channel showing.For example, Wi-Fi is direct-connected, is called Wi-Fi P2P before, is that a kind of Wi-Fi of permission equipment is connected to each other and does not need the standard of WAP (wireless access point).This standard allows Wi-Fi direct-connected device directly to transmit each other data, greatly reduces and arranges.Described setting generally includes puts two Wi-Fi direct-connected devices together, then triggers pairing or coupling procedure (coupling procedure) between them, for example, uses the button on one of them equipment.In the time that an equipment enters the scope of the direct-connected main frame of Wi-Fi, they can use point-to-point (ad-hoc) agreement of having deposited to communicate each other.
Mobile device 102 communicates with Cloud Server 106, to retrieve the AR content corresponding to the program just showing on channel.It is IEPG server here that Cloud Server 106 is configured to server 108() be connected, this server 108 provides IEPG or current TV programme selected and that watch on television set 104.As shown in Figure 1A, mobile device 102 is carried out an application program, and this application program is configured to send request to retrieve corresponding AR content to Cloud Server 106.It is the data of what television channel that this request comprises about what showing.For the synchronous AR content corresponding to the TV programme showing on television set 104 is provided in time, Cloud Server 106 is carried out one and is configured to communicate by letter to obtain the module of synchronizing information with server 108, thereby retrieves corresponding AR content for mobile device 102 to download.Download or descending (down-streamed) AR content can be displayed in mobile device 102, covers on the image from the TV programme showing by AR content.
According to an execution mode shown in Figure 1B, Television Broadcasting Limited at server 110(referred to herein as the IEPG server upgrading) in TV (TV) program guide or the live plan of generation its oneself.This IEPG data set in server 110 is upgraded constantly and is uploaded to TV-AR management server 106.The initial data of initial IEPG can be provided by following two kinds of modes: directly upload from TV broadcasting service device 108 (1), and server (subsidized server) or IEPG data supplier that (2) are subsidized by Television Broadcasting Limited provide.
Figure 1B has described the configuration of multiple servers, comprises the server 110 of TV-AR management server 106, IEPG data supplier and the server 108 of Television Broadcasting Limited.It can not be lock out operation inevitably that those skilled in the art can understand and understand these servers 106,108 and 110.According to performance, some in these servers can be implemented in a server, and in these servers one can not be physics independently because it can be implemented to a compartment system.In any case, in order to contribute to description of the invention, that these servers are described as independent operation and controlled by one or different entities.
According to an execution mode, a software module or program in TV-AR management server 106, are developed and have carried out.This module is configured to obtain IEPG data the server 108 from being moved by Television Broadcasting Limited.In one embodiment, the XMLTV form of described IEPG data for being safeguarded by XMLTV project, wherein XMLTV is a kind of for describing increasing income and the very universal file format based on XML of TV program list.XMLTV is equally also a kind of interface software between sending between the program of guidance data and the program of guide for use data.XMLTV is by being formed for the set of obtaining, operating and searching for the Software tool of the TV program list of renewal.
In one embodiment, TV-AR management server 106 is designed to have several comma separated value in its server environment (Comma Separated Values, CSV) file, to comprise the description for each television channel program.Attribute corresponding to the IEPG data set of each television channel should at least comprise following information:
The date and time that TV programme starts;
The duration of described program or total run time;
Program should show the title for described program;
The description that program should show during live.
The number of the attribute of IEPG can increase, the time (timing) that this depends on the application of AR content and shows on mobile device.Fig. 1 C has shown the functional block Figure 130 that obtains TV channel from television set to mobile device.Under the situation of the shown internet television in the left side of Fig. 1 C, application software is for example developed to, for internet television operating system (Google's Android operating system), to be received the request of data of TV channel and television channel number is sent to mobile device from mobile device by wireless link.Under the situation of traditional analog television, typically, above-mentioned application software is installed in simulated television environment and is not easy.This problem can be by providing the user interface layout in the TV-AR of mobile device side application program to overcome, thereby allow user manually to input TV channel.
When operation, mobile device sends a request with the data that comprise current time and television channel to TV-AR management server in system for cloud computing.As response, mobile device is downloaded the AR content corresponding to TV programme.Television broadcasting site server uploads to TV-AR management server by the television programme data collection of renewal constantly by network.If mobile device has successfully been downloaded the AR content correct for TV programme, an image is processed application program and is performed with by the local 3D coordinate of determining television frame (TV frame) with the video frequency pick-up head of mobile device.Once determine the local coordinate system of television frame, mobile device just shows the video views that comprises video screen framework that AR content captures to adapt to current video camera.
Carry out the Television Broadcasting Limited of ground/wired/digital video broadcast-satellite its oneself IEPG data can be provided.This IEPG has adaptation function, can regulate due to the unexpected change of some fortuitous events (as urgent news or natural calamity) to former TV programme plan, IEPG provides adaptation function to upgrade the timetable of TV programme by following two kinds of modes: (1) is notified and is presented at smart mobile phone from TV and Radio Corporation's receiving alarm; (2) upgrade the list of television programmes of rearranging.IEPG data comprise program description, transmission plan (time started and end time), in order to indicate the mark of its state.
Television Broadcasting Limited upgrades constantly its TV programme plan and IEPG data upload is arrived to TV-AR management server.This TV-AR management server identification is corresponding to the correct AR content of TV programme now.Mobile device is downloaded by the selected AR content of TV-AR management server.After AR content is successfully downloaded to mobile device, mobile device covers AR content on the image of just playing on the screen of mobile device of camera seizure.
By using the IEPG of digital television broadcasting, the AR Content Management being positioned on cloud computing server becomes the brand-new approach of one for showing a series of contents of AR widely.Because for the identification of correct AR content and without any need for such as, such as tradition mark (black and white histogram), QR code or other for retrieve the traditional images processing method of image block etc. of correct AR content from Cloud Server.
According to an execution mode, image processing algorithm is designed to determine the local 3D coordinate of visual identification 3D object in reference to 3D coordinate (being world coordinates).This image processing algorithm is known as synchronous location and map building (SLAM) algorithm, is the known image processing method of computer vision field, for solving the problem of setting up 3D map when map is located dollying head.Object is the 3D coordinate that finally obtains the 3D object (being television frame) catching in the camera visual field.Television frame track algorithm based on SLAM has created (3D map) some cloud of the difference characteristics of objects in the camera scene that comprises television frame, and the local 3D coordinate of definite television frame.For SLAM algorithm, for effective initialization that the 3D based on SLAM follows the tracks of, it is helpful for knowledge equally that the elder generation of the size (actual size of for example tv display screen) about television frame is provided.
According to an execution mode, Fig. 2 A has described and has shown that SLAM algorithm is the example that how to be used to the 3D coordinate of determining television frame.In the time of operation, the video frequency pick-up head of mobile device catches television frame constantly in 3D environment.The processing of the image based on SLAM algorithm application program in mobile device detects the difference characteristics of objects of television frame, for example acute angle and/or long limit, thereby the 3D map of generation distinctive points data set.Elder generation based on these points and TV size for example, for knowledge (40 inches of video screens), and SLAM algorithm calculates the local 3D coordinate of television frame in reference to 3D coordinate.So according to the local 3D coordinate of television frame, AR content just can be correctly presented on the display screen of mobile device.
Fig. 2 B and Fig. 2 C have shown respectively two examples in the touch screen display AR of mobile device content.Shown in Fig. 2 B is three text based AR contents that shown corresponding to the TV programme of playing.In the time that user's touch is positioned at " the information rectangle " in region, lower-left, start to play the video segment of additional AR content as shown in Figure 2 C.
According to an execution mode, have plurality of optional pattern for showing in AR.
The default mode of AR content or display mode 1 can be implemented as follows:
Step 1: mobile device sends for the request of (comprising TV channel and clock time) of AR content, then mobile device obtains AR content by downloading AR content from TV-AR server.
Step 2: if mobile device has successfully been determined the coordinate of television frame by the image of the video frequency pick-up head from mobile device, will start so to show AR content and upgrade constantly AR content corresponding to current time.
Step 3: if video frequency pick-up head cannot find television frame from video, AR content disappears the screen from video capture so.If video frequency pick-up head can capture television frame again, AR content will be shown again so.
The alternative mode of AR content or display mode 2 will start after initial video frequency pick-up head successfully captures television frame.Once AR content is shown, user does not need to catch constantly television frame to maintain the demonstration of AR content.AR content is continued to show and is upgraded, and not needed the picture catching for television frame by video frequency pick-up head.
Other alternative modes or the display mode 3 of AR content will independently be shown, and not needed the picture catching to television frame.In the time that mobile device completes the download of AR content, AR content will be displayed on the screen of mobile device, and does not consider current the caught image state of video frequency pick-up head.
Fig. 3 shows the flow chart of the flow process 300 of implementing in default mode.Flow process 300, still also can be implemented with the combination of software and hardware with implement software by preferably.In step 302, user starts TV-AR application program.According to performance, such application program can or be provided by website for Downloadable application program.In one embodiment, described application program is configured to make mobile device to open its camera.In step 304, by using the camera in mobile device, this camera catches television set (being display screen).In step 306, mobile device by and television set between radio communication further obtain current selected television channel.Described radio communication can be passed through the direct-connected or bluetooth of Wi-Fi, Wi-Fi and realize.Then, TV-AR application program activates the specific AR-TV function corresponding to the television channel data sending from television set.Mobile device sends one and comprises that television channel and the request of present clock time are to TV-AR management server, for downloading the suitable AR content relevant with selected television channel.Described TV-AR management server provides correct AR content request from mobile device with response.Once complete the download of AR content, if television frame is also still positioned at the area of visual field of camera, mobile device shows AR content.
Fig. 4 A shows the corresponding data flow 400 between different server (as shown in Figure 1B), and wherein TV-AR management server is provided for single Television Broadcasting Limited.This Television Broadcasting Limited uploads to TV-AR management server by the IEPG packet of renewal constantly by the Internet.TV-ARR management server maintenance data base, so that providing of correct AR content to be provided according to the time shaft of the television channel that Television Broadcasting Limited was provided.Mobile device is installed specific TV-AR application program, and this application program can be downloaded the AR content for specific TV broadcaster.
Fig. 4 B and Fig. 4 C have described respectively database 410 and the AR content data set 420 of the link of IEPG data set, and this AR content data set 420 correctly identifies the AR content of making the TV programme in when request corresponding to mobile device for Television Broadcasting Limited.As shown in Fig. 4 B and Fig. 4 C, there are two look-up tables for the TV programme on axle retrieval time correctly and corresponding to the specific AR content of the known current time of onboard clock of mobile device.Fig. 4 B shows look-up table 410 and the AR content of IEPG.Fig. 4 C shows the look-up table 420 for selecting necessary AR file, as the preparation that downloads to mobile device.
Fig. 4 D shows a kind of system configuration 450, comprising mobile device 452, for example conventional television of television equipment 454(or there is the computing equipment of display screen) and the TV-AR management server 456 of multiple TV programme of providing for different Television Broadcasting Limiteds.Can expand to multiple Television Broadcasting Limiteds for the description of single Television Broadcasting Limited above provides their AR content for the situation of their TV programme independently.Television Broadcasting Limited includes but not limited to ground TV broadcast company, CNN, internet television company and STC Satellite Television Corporation.Similarly, be arranged on TV-AR application program in mobile device be performed with by and the operating system of television set 454 between radio communication to identify be which TV and Radio Corporation takies television set 454.Then, mobile device 452 activates only for the current spendable specific T V-AR application program module of Television Broadcasting Limited that is just taking television set 454.Then, mobile device is connected from TV-AR management server 456 and is downloaded correct AR content by the Internet, and the server (one of supplier 458) that this server 456 is configured to from specifying is retrieved corresponding AR content.
Fig. 5 A and Fig. 5 B have described respectively the example user interface layout in the time that corresponding AR information is just showing on mobile device.In Fig. 5 A, AR content is shown corresponding to time shaft.The demonstration of AR content starts, keeps to show and disappear according to the defined AR time shaft of the database specification in TV-AR management server.
Fig. 5 B, main AR content is directly presented on the screen of mobile device, and disappears according to AR time shaft specification.But the AR menu that user can be positioned at screen right side by selection shows other AR information.
According to an execution mode, the content of TV program of Television Broadcasting Limited can change according to diverse location.Therefore, in the situation that not possessing an embodiment of the invention, user can receive correct AR content a position, but may receive in another location incorrect AR content.
Fig. 6 shows the configuration 600 that is modified to provide location-based TV-AR content.According to an execution mode, mobile device for example, sends to TV-AR management server by its position data (gps data), television channel and current clock time by wireless internet connection.The search of TV-AR management server is corresponding to the correct IEPG data of ad-hoc location.Then, TV-AR server is sent in the correct AR message data set of current television program near the television set of mobile device.
Fig. 7 shows the example arrangement of TV-AR server, and this server is configured to provide the televiewer's who had watched the AR content discharging from TV-AR server statistics.Multiple mobile devices that TV-AR server is configured to from being positioned at diverse geographic location receive request.These requests that comprise the gps data of each mobile device can be used as the feedback information for AR content provider or Television Broadcasting Limited.According to an execution mode, TV-AR server is designed to the statistical analysis for the televiewer of use AR content by the requests classification from these mobile devices.These analysiss of statistical data at least comprise: (1) current televiewer's who has activated the service for receiving AR application program sum; For example, in (1) the kind situation of (per hour, every day, weekly or monthly) spectators' sum in (2) time windows (time window); (3) alternatively obtain the spectators' of further detailed AR content sum with AR interface; (4) each spectators have watched the duration of the specific AR content of specific TV channel; (5) spectators' geographical distribution.These statistical analyses can be of value to AR content provider or Television Broadcasting Limited assesses the effect of for example, AR content for the object predetermined for (commercial advertisement, for important information notice or other objects of general public).
The present invention, still also can be implemented with the combination of hardware or hardware and software with implement software by preferably.The present invention also can realize with the computer-readable code on computer-readable medium.Described computer-readable medium is that can store can be by any data storage device of computer system reads after data and this data.The example of described computer-readable medium comprises read-only memory, random access storage device, CD-ROM, DVD, tape, optical data storage equipment and carrier wave.Described computer-readable medium also can be distributed in the computer system of network connection, thereby computer-readable code is stored and carried out in the mode distributing.
Flow process discussed above, order or step and feature are relevant each other, believe each novelty independently that has in this area simultaneously.These disclosed flow processs and order can be by separately or carry out with arbitrary combination, so that novel and non-obvious system or part system to be provided.Can be understood as, even from broadest, have the each ad hoc fashion put into practice of being reduced being less than in flow process or order, these flow processs and sequential combination also generate a novel combination equally independently.
The present invention is to a certain extent by fully detailed description.It will be understood by those skilled in the art that the disclosed just example of current embodiment, within the spirit and principles in the present invention all, any amendment of doing, be equal to replacement etc., within all should being included in protection scope of the present invention.Therefore, scope definition of the present invention is the explanation of its protection range instead of above embodiment.
Claims (23)
1. for a method for augmented reality (AR) content is provided, described method comprises:
In server, receive the request from mobile device, in order to download described AR content according to the image in the demonstration screen display of television equipment just, wherein said mobile device and described television equipment carry out radio communication with reception the details about the image showing on described television equipment;
From database, search for described AR content according to the details of described image, wherein said AR content is synchronizeed in time with the image showing on described television equipment; And
Described AR content is discharged into described mobile device, to show described AR content on the described image in described mobile device.
2. method according to claim 1, wherein said television equipment is television set or the computing equipment with display screen.
3. method according to claim 1, wherein said television equipment has wireless communication ability, to communicate described details are discharged into described mobile device with described mobile device.
4. method according to claim 1, wherein said details comprise the channel of the video that contains described image.
5. method according to claim 4, wherein said request comprises the described details with local zone time of described image, to help searching for described AR content according to internet electronic program guide (IEPG) in server.
6. method according to claim 5, wherein said server is configured to upgrade the IEPG being provided by least one TV programme company.
7. method according to claim 6, the described AR content being wherein just displayed on described mobile device comprises interactive menu, for further show additional content in the time that described menu is activated.
8. method according to claim 7, wherein said additional content comprises content of multimedia.
9. method according to claim 4, wherein said request comprises the gps data in the geographical position of indicating described mobile device, the described details with local zone time of just shown picture, to help searching for described AR content according to internet electronic program guide (IEPG) in server.
10. method according to claim 9, wherein said server is configured to obtain the described AR content for described geographical position.
11. methods according to claim 1, are wherein discharged into described mobile device by described AR content, to show on the described image in described mobile device that described AR content comprises:
Obtain described image; And
On described image, cover described AR content according to the precalculated position of described image.
12. methods according to claim 11, the precalculated position of wherein said image is calculated by described mobile device.
13. methods according to claim 11, the precalculated position of wherein said image is that the image by take the display screen of described television equipment with the video frequency pick-up head of mobile device calculates, and wherein said mobile device executive software module is to determine the 3D coordinate of display screen of described television equipment, for described AR content being covered to described image according to described 3D coordinate.
14. methods according to claim 1, wherein said server is configured to collect user's the statistics about having accessed described AR content, the one of described statistics based in time, geographical position and specific channel.
15. 1 kinds for providing the method for augmented reality (AR) content, and described method comprises:
Send request to server from mobile device, to obtain described AR content for covering described AR content on the image showing on the display screen of television equipment, wherein said mobile device and described television equipment carry out radio communication to receive the details about the image showing on described television equipment;
From described server, retrieve described AR content, wherein said server be configured to from described request search for described AR content in the database of the time synchronized that comprises; And
On described image in described mobile device, show described AR content.
16. methods according to claim 15, wherein said television equipment has wireless communication ability, to communicate that with described mobile device described details are discharged into this mobile device.
17. methods according to claim 15, wherein said details comprise the channel of at least described image.
18. methods according to claim 15, wherein said request comprises the described details with local zone time of described image, to help searching for suitable AR content according to internet electronic program guide (IEPG) in server.
19. methods according to claim 18, wherein said server is configured to upgrade the IEPG being provided by least one TV programme company.
20. methods according to claim 19, wherein just shown described AR content comprises interactive menu, for further show additional content in the time that described menu is activated.
21. methods according to claim 20, wherein said additional content comprises content of multimedia.
22. methods according to claim 17, wherein said request comprises the described details with local zone time of the gps data in the geographical position of indicating described mobile device, described image, to help searching for suitable AR content according to internet electronic program guide (IEPG) in server.
23. methods according to claim 22, wherein said server is configured to obtain the suitable AR content for described geographical position.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201361854162P | 2013-04-19 | 2013-04-19 | |
| US61/854,162 | 2013-04-19 | ||
| US13/926,962 | 2013-06-25 | ||
| US13/926,962 US20140317659A1 (en) | 2013-04-19 | 2013-06-25 | Method and apparatus for providing interactive augmented reality information corresponding to television programs |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN103945274A true CN103945274A (en) | 2014-07-23 |
Family
ID=51192716
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310689163.0A Pending CN103945274A (en) | 2013-04-19 | 2013-12-14 | Method and equipment for providing interactive augmented reality information corresponding to television programs |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103945274A (en) |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105468159A (en) * | 2016-01-11 | 2016-04-06 | 湖北视纪印象科技股份有限公司 | Traveling instruction system based on augmented reality (AR) and method thereof |
| CN106210909A (en) * | 2016-08-15 | 2016-12-07 | 深圳Tcl数字技术有限公司 | TV the display processing method of content, Apparatus and system |
| CN104360598B (en) * | 2014-10-23 | 2017-02-01 | 四川长虹电器股份有限公司 | HTML5 based intelligent household movement control method |
| WO2018018698A1 (en) * | 2016-07-29 | 2018-02-01 | 宇龙计算机通信科技(深圳)有限公司 | Augmented reality information processing method, device and system |
| CN107820133A (en) * | 2017-11-21 | 2018-03-20 | 三星电子（中国）研发中心 | Method, television set and the system of virtual reality video are provided in television set |
| CN108234065A (en) * | 2016-12-15 | 2018-06-29 | 中国电信股份有限公司 | Augmented reality content transmission method and system |
| CN108429794A (en) * | 2018-02-12 | 2018-08-21 | 上海玄彩美科网络科技有限公司 | AR service discovery methods and device based on bluetooth service agreement |
| CN110352442A (en) * | 2016-12-30 | 2019-10-18 | 脸谱公司 | For providing the system and method for augmented reality individualized content |
| CN110417493A (en) * | 2018-04-28 | 2019-11-05 | 华为技术有限公司 | A kind of blind sweep method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110138416A1 (en) * | 2009-12-04 | 2011-06-09 | Lg Electronics Inc. | Augmented remote controller and method for operating the same |
| CN102595228A (en) * | 2011-01-07 | 2012-07-18 | 三星电子株式会社 | Content synchronization apparatus and method |
| CN102647512A (en) * | 2012-03-21 | 2012-08-22 | 广州市凡拓数码科技有限公司 | All-round display method of spatial information |
| CN103002410A (en) * | 2012-11-21 | 2013-03-27 | 北京百度网讯科技有限公司 | Augmented reality method and system for mobile terminals and mobile terminals |
-
2013
- 2013-12-14 CN CN201310689163.0A patent/CN103945274A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110138416A1 (en) * | 2009-12-04 | 2011-06-09 | Lg Electronics Inc. | Augmented remote controller and method for operating the same |
| CN102595228A (en) * | 2011-01-07 | 2012-07-18 | 三星电子株式会社 | Content synchronization apparatus and method |
| CN102647512A (en) * | 2012-03-21 | 2012-08-22 | 广州市凡拓数码科技有限公司 | All-round display method of spatial information |
| CN103002410A (en) * | 2012-11-21 | 2013-03-27 | 北京百度网讯科技有限公司 | Augmented reality method and system for mobile terminals and mobile terminals |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104360598B (en) * | 2014-10-23 | 2017-02-01 | 四川长虹电器股份有限公司 | HTML5 based intelligent household movement control method |
| CN105468159A (en) * | 2016-01-11 | 2016-04-06 | 湖北视纪印象科技股份有限公司 | Traveling instruction system based on augmented reality (AR) and method thereof |
| WO2018018698A1 (en) * | 2016-07-29 | 2018-02-01 | 宇龙计算机通信科技(深圳)有限公司 | Augmented reality information processing method, device and system |
| CN106210909A (en) * | 2016-08-15 | 2016-12-07 | 深圳Tcl数字技术有限公司 | TV the display processing method of content, Apparatus and system |
| WO2018032693A1 (en) * | 2016-08-15 | 2018-02-22 | 深圳Tcl数字技术有限公司 | Television display content processing method, device and system |
| CN108234065A (en) * | 2016-12-15 | 2018-06-29 | 中国电信股份有限公司 | Augmented reality content transmission method and system |
| CN108234065B (en) * | 2016-12-15 | 2021-04-30 | 中国电信股份有限公司 | Augmented reality content transmission method and system |
| CN110352442A (en) * | 2016-12-30 | 2019-10-18 | 脸谱公司 | For providing the system and method for augmented reality individualized content |
| CN107820133A (en) * | 2017-11-21 | 2018-03-20 | 三星电子（中国）研发中心 | Method, television set and the system of virtual reality video are provided in television set |
| CN107820133B (en) * | 2017-11-21 | 2020-08-28 | 三星电子（中国）研发中心 | Method, television and system for providing virtual reality video on television |
| CN108429794A (en) * | 2018-02-12 | 2018-08-21 | 上海玄彩美科网络科技有限公司 | AR service discovery methods and device based on bluetooth service agreement |
| CN110417493A (en) * | 2018-04-28 | 2019-11-05 | 华为技术有限公司 | A kind of blind sweep method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103945274A (en) | Method and equipment for providing interactive augmented reality information corresponding to television programs | |
| US20140317659A1 (en) | Method and apparatus for providing interactive augmented reality information corresponding to television programs | |
| KR101796005B1 (en) | Media processing methods and arrangements | |
| US9967708B2 (en) | Methods and systems for performing actions based on location-based rules | |
| US8387084B1 (en) | Systems and methods for detecting unauthorized use of a user equipment device | |
| US20150312618A1 (en) | Systems and Methods for Generating a Full-Motion Video Mosaic Interface for Content Discovery with User-Configurable Filters | |
| KR101850482B1 (en) | System and method for providing providing augmented reality service associated with broadcasting | |
| US20160295269A1 (en) | Information pushing method, device and system | |
| KR20160016945A (en) | Synchronizing an application on a companion device | |
| CN103748889A (en) | EPG aggregation from multiple sources | |
| CN103797808A (en) | System and method for visual selection of elements in video content | |
| JP2006005897A (en) | Terminal device, content distribution system, information output method, information output program | |
| MX2012010599A (en) | Interests and demographics profile for advanced broadcast services. | |
| KR20140118605A (en) | Server and method for transmitting augmented reality object | |
| US20140344053A1 (en) | Electronic device and method for manipulating the same | |
| US20190037268A1 (en) | Providing a plurality of points of view of digital environments | |
| CN105103566A (en) | Systems and methods for identifying video segments for displaying contextually relevant content | |
| CN113473208A (en) | Barrage display method and device, computer equipment and storage medium | |
| CN105163152A (en) | Interactive access method for television interaction system | |
| CN104010206A (en) | Virtual reality video playing method and system based on geographic position | |
| CN113573090A (en) | Content display method, device and system in game live broadcast and storage medium | |
| CN103797811A (en) | Systems and methods for consumer control over interactive television exposure | |
| CN103748586B (en) | Smart television | |
| CN105407405A (en) | Method and device for configuring interactive information of interactive TV system | |
| US20130205334A1 (en) | Method and apparatus for providing supplementary information about content in broadcasting system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20140723 |