WO2016098415A1 - 情報処理装置、情報処理方法、およびプログラム - Google Patents
情報処理装置、情報処理方法、およびプログラム Download PDFInfo
- Publication number
- WO2016098415A1 WO2016098415A1 PCT/JP2015/077129 JP2015077129W WO2016098415A1 WO 2016098415 A1 WO2016098415 A1 WO 2016098415A1 JP 2015077129 W JP2015077129 W JP 2015077129W WO 2016098415 A1 WO2016098415 A1 WO 2016098415A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- score
- action
- variable
- information processing
- processing apparatus
- Prior art date
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 67
- 238000003672 processing method Methods 0.000 title description 5
- 230000009471 action Effects 0.000 claims abstract description 114
- 238000004364 calculation method Methods 0.000 claims abstract description 78
- 238000011161 development Methods 0.000 claims description 15
- 230000004913 activation Effects 0.000 claims description 4
- 230000004044 response Effects 0.000 claims description 2
- 238000000034 method Methods 0.000 description 45
- 230000008569 process Effects 0.000 description 42
- 238000012545 processing Methods 0.000 description 29
- 238000004891 communication Methods 0.000 description 20
- 239000013598 vector Substances 0.000 description 12
- 238000003860 storage Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 238000007405 data analysis Methods 0.000 description 8
- 238000004458 analytical method Methods 0.000 description 7
- 238000003384 imaging method Methods 0.000 description 7
- 230000008859 change Effects 0.000 description 6
- 238000009826 distribution Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 4
- 239000004065 semiconductor Substances 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 238000005401 electroluminescence Methods 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 238000012417 linear regression Methods 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000001151 other effect Effects 0.000 description 2
- 239000013589 supplement Substances 0.000 description 2
- 230000000386 athletic effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000005065 mining Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2665—Gathering content from different sources, e.g. Internet and satellite
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/251—Learning process for intelligent management, e.g. learning user preferences for recommending movies
- H04N21/252—Processing of multiple end-users' preferences to derive collaborative data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25866—Management of end-user data
- H04N21/25891—Management of end-user data being end-user preferences
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2668—Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
- H04N21/4826—End-user interface for program selection using recommendation lists, e.g. of programs or channels sorted out according to their score
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/488—Data services, e.g. news ticker
- H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8549—Creating video summaries, e.g. movie trailer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/91—Television signal processing therefor
- H04N5/93—Regeneration of the television signal or of selected parts thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
Definitions
- the present disclosure relates to an information processing apparatus, an information processing method, and a program.
- Patent Document 1 describes a technique for automatically extracting, integrating, and reproducing a swelled portion desired by a viewer from an audio signal in TV broadcasting.
- the climax portion is determined based on the voice uttered by the audience for the action. That is, the content part is not necessarily extracted based on the result of evaluating the action itself. Therefore, for example, when the audience utters sound due to a factor other than the action (sport play, etc.), an inappropriate part may be extracted. Also, in the case where there is no audience or an action that has not yet occurred, it is difficult to determine the excitement because the voice produced by the audience is not acquired.
- the present disclosure proposes a new and improved information processing apparatus, information processing method, and program capable of evaluating an action itself based on a variable related to the action.
- variable acquisition unit that acquires the first variable related to the content of the action and the second variable related to the context in which the action occurs, and the above based on the first variable and the second variable
- An information processing apparatus including a score calculation unit that calculates a score for evaluating an action is provided.
- the first variable related to the content of the action and the second variable related to the context in which the action occurs are acquired, and the processor converts the first variable and the second variable to the first variable.
- An information processing method including calculating a score for evaluating the action based on the information is provided.
- a program for causing a computer to realize a function of calculating a score for evaluating an action is provided.
- the action itself can be evaluated based on the variables related to the action.
- FIG. 3 is a diagram for conceptually explaining an embodiment of the present disclosure. It is a figure showing an example of composition of a system concerning one embodiment of this indication. It is a figure for demonstrating the position of the score calculation process in one Embodiment of this indication. It is a figure for demonstrating the component of the score calculation process in one Embodiment of this indication. It is a graph which shows an example of the score computed in one embodiment of this indication. It is a figure which shows the example which applied the score calculated in one Embodiment of this indication to the caption of an image
- FIG. 3 is a block diagram illustrating a hardware configuration example of an information processing apparatus according to an embodiment of the present disclosure.
- FIG. 1 is a diagram for conceptually explaining an embodiment of the present disclosure.
- a soccer video 1100 a and a figure skating video 1100 b are displayed on the television 100.
- it is very common today to watch sports videos provided by broadcasting or distribution.
- the great play and performance captured in sports videos often impress users.
- video content is recommended to the user in the example shown in the figure.
- it is easy to recommend content when there are clear sports that the user is interested in and sports that are not, it is easy to recommend content. More specifically, when the user is interested in soccer and knows that the user is not interested in figure skating, it is easier to recommend the video 1100a as the content to be viewed by the user than the video 1100b.
- the action is evaluated based on the first variable related to the content of the action (for example, play or performance in sports) and the second variable related to the context in which the action occurs.
- the first variable related to the content of the action for example, play or performance in sports
- the second variable related to the context in which the action occurs By calculating the score, it is possible to determine which one of the play captured in the video 1100a and the performance captured in the video 1100b is excellent in the example shown in FIG.
- FIG. 2 is a diagram illustrating a configuration example of a system according to an embodiment of the present disclosure.
- system 10 includes a television 100, a recorder 150, a server 200, and a camera 300.
- the television 100 and the recorder 150 are examples of terminal devices that provide the video distributed from the server 200 to the user.
- the video is transmitted from the server 200 to the television 100 by broadcast waves (S12).
- the video may be distributed from the server 200 to the television 100 via the Internet or the like.
- the video is transmitted from the server 200 to the recorder 150 by broadcast waves, for example (S13).
- the video may be distributed from the server 200 to the recorder 150 via the Internet or the like.
- the user may view the video distributed or transmitted to the television 100 in real time, or may reproduce the video recorded by the recorder 150 (S14) and view it using the television 100.
- a terminal device is not restricted to what both the television 100 and the recorder 150 are installed. For example, if the video is to be viewed exclusively in real time, the recorder 150 is not necessary.
- a personal computer, a tablet, a smartphone, or the like can be used to view the video in real time or to play back the recorded video.
- Such a terminal device is realized by, for example, a hardware configuration of an information processing device described later.
- the server 200 distributes the video provided from the camera 300 to the television 100 and / or the recorder 150. More specifically, the server 200 distributes the video to the television 100 and the recorder 150 by, for example, transmission using broadcast waves or distribution via the Internet.
- the server 200 is provided with video from the two cameras 300a and 300b (S11a and S11b).
- the server 200 may select one of these videos and distribute it to the television 100 and / or the recorder 150.
- the server 200 may distribute both videos to the television 100 and / or the recorder 150.
- the server 200 is realized by, for example, cooperation of a single server device on the network or a plurality of server devices. Each server device is realized by, for example, a hardware configuration of an information processing device described later.
- the camera 300 provides video to the server 200.
- the camera 300 includes two cameras 300a and 300b.
- the cameras 300a and 300b respectively shoot different sports plays or performances. More specifically, the camera 300a is shooting a soccer play, and the camera 300b is shooting a figure skating performance. Photographing by these cameras 300 may be performed in parallel, for example, or may be performed at different times. Also, the provision of video from the camera 300 to the server 200 (S11a, S11b) may be performed in parallel with the imaging or may be performed after the imaging is completed.
- the camera 300 can be, for example, a digital video camera. However, in the present embodiment, the video does not necessarily have to be digital data. For example, an analog video camera may be included in the camera 300.
- the camera 300 may have, for example, a communication function, an input function, and an arithmetic function in addition to the video shooting function. In that case, the camera 300 is realized by a hardware configuration of an information processing apparatus described later.
- the score of play or performance in sports is calculated.
- the calculation of the score is performed by the server 200, for example.
- the server 200 determines which of the two videos provided in parallel from the cameras 300a and 300b is to be distributed to the television 100 and / or the recorder 150 (S12, S13) based on the score. May be.
- the server 200 edits the video provided from either or both of the cameras 300a and 300b and generates a video (for example, a digest video) to be distributed to the television 100 and / or the recorder 150. You may determine the order and length of each image
- the server 200 needs to determine which video is to be distributed when only one of the cameras 300a and 300b provides the video or when the video to be distributed is designated by the user.
- the score may be distributed to the television 100 and / or the recorder 150 together with the video as metadata.
- the calculation of the score may be performed by the television 100 or the recorder 150.
- the television 100 may determine whether to recommend the user to view the video distributed from the server 200 based on the score.
- the recorder 150 may determine the priority of recording or playback (S14) of the video distributed from the server 200 based on the score. These determinations may be performed according to the score calculated by the television 100 or the recorder 150, or may be performed according to the score distributed as metadata from the server 200.
- the television 100 and the recorder 150 cooperate to allow the user to view one of a plurality of videos distributed from the server 200 (for example, videos provided by the cameras 300a and 300b, respectively) on the television 100, Recording the other with the recorder 150 may be determined according to the score.
- the score may be calculated by the camera 300.
- the cameras 300a and 300b may determine whether to provide the server 200 with the video captured by each camera based on the score.
- FIG. 3 is a diagram for describing the positioning of score calculation processing according to an embodiment of the present disclosure.
- FIG. 3 shows an image / sensor data analysis process 410, a tag input process 420, and a media log analysis process 430 as processes before the score calculation process 500.
- FIG. 3 also shows a distribution / view / playback video selection process 440, a caption generation process 450, and a highlight generation process 460 as subsequent processes of the score calculation process 500.
- these pre-stage and post-stage processes will be further described.
- the video / sensor data analysis processing 410 is processing for analyzing, for example, video captured by the camera 300 or sensor data detected by a sports player (actor performing an action) or a sensor attached to a tool. For example, it is possible to detect the subject of the video and the position, posture, movement, etc. of the subject by video analysis. Further, by analyzing sensor data such as an acceleration sensor and an angular velocity sensor, it is possible to detect an impact generated in a player or a tool, their posture, movement, and the like. In the video / sensor data analysis process 410, for example, a variable relating to the content of an action (sport play or performance) captured in the video can be acquired by analyzing the video or sensor data.
- the analysis of video and sensor data is executed by a processor such as a CPU (Central Processing Unit) included in an information processing apparatus that realizes the television 100, the recorder 150, the server 200, or the camera 300, for example.
- a processor such as a CPU (Central Processing Unit) included in an information processing apparatus that realizes
- the tag input process 420 is, for example, a process in which a photographer who is shooting with the camera 300 or an observer on the server 200 side inputs a tag regarding sports play or performance shot with the camera 300.
- the tag is input by an input device included in an information processing device that realizes the camera 300 or the server 200, for example.
- the tag may be input in association with a specific time stamp of the captured video, for example.
- the tag can indicate the contents of individual actions (sport play or performance), the results, and the like.
- the tag may be input in association with the entire unit of the captured video.
- the tag may indicate a variable related to a context in which an action (playing or acting) occurs, such as a game or competition positioning or result.
- tags may be entered (e.g., automatically) according to the progress of a game or the like. Again, the tag may indicate a variable related to the context in which the action occurs, such as the remaining time of the match.
- the media log analysis process 430 is a process of analyzing a media log related to sports play and action (action) taken by the camera 300. While the video / sensor data analysis process 410 and the tag input process 420 can be executed in parallel with the occurrence of an action, the media log analysis process 430 is often executed after an action has occurred. For example, the media log analysis processing 430 collects comments and contents related to play and performance by performing text mining on social media posts and news articles, and takes up play and performance on TV / radio broadcasting. Includes the process of counting time. These processes do not necessarily indicate the variables related to the content of the action or the context in which the action occurs, but as will be described later, they are used to obtain the coefficients for calculating the action score from these variables. Can be done.
- the distribution / viewing / reproduction video selection processing 440 is a score calculation processing for, for example, a video distributed by the server 200 to the television 100 or the recorder 150, a video viewed on the television 100, and a video reproduced by the recorder 150 and output from the television 100 This is a process of determining based on the score calculated in 500.
- the distribution / viewing / reproduction video selection processing 440 for example, when video is provided to the server 200 in parallel from the cameras 300a and 300b, or two or more videos are distributed from the server 200 to the television 100 in parallel. If there are a plurality of selectable videos, such as when two or more videos are recorded on the recorder 150, the process can be executed.
- the caption generation process 450 is a process for generating a caption based on the score inserted into the video output on the television 100.
- the caption may be generated in the server 200 and distributed to the television 100 or the recorder 150 together with the video.
- the caption may be generated by the television 100 or the recorder 150 based on metadata distributed from the server 200 together with the video.
- the highlight generation process 460 is a process for generating a highlight video by combining parts of the video shot by the camera 300.
- the highlight video may be generated, for example, by extracting a part whose score exceeds a threshold from the video provided by the camera 300.
- the highlight video may be generated from a single video or may be generated from a plurality of videos.
- the plurality of videos may be, for example, images of the same sports game or competition from different angles, or may be images of different sports games or competitions.
- the highlight video may be generated in the server 200, for example, or may be generated in the television 100 or the recorder 150 using the video distributed from the server 200.
- FIG. 4 is a diagram for describing components of score calculation processing according to an embodiment of the present disclosure.
- FIG. 4 shows a variable acquisition unit 501, a score calculation unit 503, a score output unit 505, and a coefficient acquisition unit 507 as components of the score calculation process 500.
- FIG. 4 shows a coefficient DB 509 and a coefficient calculation unit 511 as additional components.
- the variable acquisition unit 501, the score calculation unit 503, the score output unit 505, the coefficient acquisition unit 507, and the coefficient calculation unit 511 are devices that execute the score calculation process 500 (for example, the server 200, the television 100, the recorder 150, or This is realized by the processor of the camera 300) operating according to a program.
- the coefficient DB 509 is realized by, for example, the memory or the storage of the above device.
- the variable acquisition unit 501 acquires a variable V10 and a variable V20.
- the variable V10 is a variable related to the content of an action (sport play or performance) including, for example, a sport type V11, a play type V12, and a success / failure V13.
- the variable V10 may include a vector in which values are combined.
- success / failure V13 is 0.
- variable V10 can be a three-dimensional vector.
- a physical quantity such as a ball speed in baseball or a rotational speed in figure skating may be included in the variable V10 related to the content of the action.
- variable V20 is a variable related to a context in which an action (sport play or performance) occurs, including, for example, the player V21, the superiority / inferiority V22, the victory / defeat V23, and the like.
- the variable V20 may include a vector in which values are combined, like the variable V10.
- the player V21 is a variable relating to the actor who executed the action.
- the player V21 may be a division value for each player, or for each player rank (seed for tournaments, regular and substitutes for team sports, batting order for baseball, etc.) defined for each sport. It may be a segment value.
- the superiority / inferiority V22 is a variable related to the progress of the battle until the action occurs in the action that occurs during the battle.
- the superiority / inferiority V22 may be a value determined by whether a player or a team whose score is to be calculated has won or lost when an action (play or competition) occurs in a sport of competing points.
- the superiority / inferiority V22 may be determined in a binary manner depending on whether there are more points than the opponent, or a stepped value may be determined according to the number of points that have won / behind. .
- Victory / Loss V23 is a value indicating the victory or defeat of the player or team whose score is to be calculated, as a result of a battle derived from the occurrence of an action (play or competition). Like dominance / inferiority V22, victory / defeat V23 may be determined in a binary manner, or a stepped value may be determined according to the number of points (whether won by close battle or won by a large difference). Good. For example, a sport where the change in points due to the success of various plays is stipulated by the rules (for example, 1 point if a soccer shoot is successful, 3 points if two runners in baseball and hit a home run, rugby For each play that is expected to occur, it is possible to predict the victory / defeat V23 when they occur. Also, in a sport such as figure skating where the player performs according to the program, the victory / defeat V23 caused by the success / failure of the individual play can be predicted.
- variable acquisition unit 501 acquires the variable V10 from the video / sensor data analysis process 410 and the tag input process 420.
- variable acquisition unit 501 acquires the variable V20 from the tag input process 420, for example.
- the variable acquisition unit 501 internally processes a program part for acquiring the variables V10 and V20. Is realized by executing.
- the variable acquisition unit 501 receives the variables V10 and V20 from those devices via the communication device. It can be a software interface, such as a driver.
- the score calculation unit 503 calculates an action (sport play or performance) score based on the variables V10 and V20 acquired by the variable acquisition unit 501.
- the calculated score may be, for example, an evaluation of the splendor of the action, more specifically, the magnitude of the impression that the action gives to the audience (for example, a user who views the video).
- the action for which the score is calculated in the present embodiment is play or performance of sports, but the unit may be various.
- the score may be calculated for a group of generally recognized plays and performances such as one game or competition.
- the score may be calculated for fine units of play or performance, for example, each pass or shot in soccer, one ball in baseball, individual jump or spin in figure skating.
- the score is calculated by using an intermediate unit between the above two units, for example, a series of ball movements up to a shot in soccer, inning in baseball, performance of individual players in figure skating, etc. Also good.
- the score calculation target action includes a plurality of types of sports
- the score calculation unit 503 may calculate a score common to each type of sports.
- the score calculation unit 503 may correct the score according to the popularity of each type of sport. More specifically, for example, the score calculation unit 503 may correct the score upward for a sport with low popularity.
- Such an upward correction of the score can be performed, for example, as shown in the following Expression 1 using the score before correction (Score ') and the popularity P of the sport type (0 ⁇ P ⁇ 1).
- the score of a sport having a low popularity P is corrected upward compared to the score of a sport having a higher popularity P.
- the popularity P is estimated based on, for example, the athletic population, the number of web searches for related words, the TV broadcast time of related content, and the like.
- the score calculation unit 503 may calculate a score for each attribute of the player (actor who executes the action) or the user (the user of the content related to the action). For example, the score calculation unit 503 may calculate a score of a game or a competition constituted by the play or performance of a plurality of players for each player. Further, the score may be calculated for each attribute common to a plurality of players, for example, nationality, team, age, etc., not for the individual player. Similarly, the score calculation unit 503 may calculate a personalized score according to the preference of the user. The score calculation unit 503 may calculate a score for each attribute common to a plurality of users, for example, nationality, gender, age, and the like. As an example of a combination of these, the score calculation unit 503 determines the score when the nationalities of the player and the user match (for example, support of the national team in the Olympics) or match the age (support of players of the same age). You may correct upward.
- the score output unit 505 outputs the score calculated by the score calculation unit 503. For example, when the distribution / viewing / playback video selection processing 440, caption generation processing 450, and / or highlight generation processing 460 described above is performed by the same device as the score calculation processing 500, the score output unit 505 internally This is realized by the processor executing a program portion for providing scores from the score calculation unit 503 to these processing units. Alternatively, when the above processing is performed by a device different from the score calculation processing 500, the score output unit 505 can be a software interface such as a driver that transmits a score to these devices via a communication device.
- the coefficient acquisition unit 507 acquires, from the coefficient DB 509, a coefficient for the score calculation unit 503 to calculate a score based on the variables V10 and V20.
- the coefficient may be calculated in advance by a coefficient calculation unit 511, which will be described later, and stored in the coefficient DB 509, for example.
- the coefficient may be calculated or determined separately and read into the coefficient DB 509.
- An example of calculating a score using a coefficient is expressed by the following expression 2 where V 1 is a vector of a variable V10, V 2 is a vector of a variable V20, and W 1 and W 2 are coefficient vectors corresponding to the vector. .
- the score can be calculated as a vector.
- the matrix of the coefficients W 1 and W 2 is set so that the element of the score vector corresponds to the score of each attribute. Also good.
- a coefficient vector (W 3 ) may be separately assigned to the vector (which may be added as V 3 to Equation 2 for example).
- the coefficient calculation unit 511 calculates the above coefficient based on the relationship between the variables V10 and V20 related to the action acquired by the variable acquisition unit 501 and the audience reaction A10 for the action. More specifically, the coefficient calculation unit 511 collects the variables V10 and V20 and the audience reaction A10 for actions that have occurred in the past, and performs machine learning based on these, thereby performing the variables V10 and V20 and the reaction A10.
- the coefficient indicating the relationship with is specified.
- various known methods such as a linear regression model and a non-linear regression model can be used.
- the audience reaction A10 can be expressed as, for example, the degree of media activation.
- media log A11 and audience rating A12 are shown as audience reaction A10.
- Such an index can be acquired by the media log analysis processing 430 described above, for example. Accordingly, the audience reaction A10 may include other times such as the time taken up for playing or acting in television / radio broadcasting.
- the degree of media activation indicated by such an index is the splendor of the action that the score calculated by the score calculation unit 503 is trying to express, more specifically, the impression that the action gives to the user. It is treated as an indicator of the size of.
- the score calculation process 500 it is possible to predict the score when an action (sport play or performance) that has not yet occurred occurs. More specifically, in this case, the variable acquisition unit 501 acquires the variable V10 related to the content of the uncompleted action for each of the development patterns of the action predicted at that time, and the score calculation unit 503 displays the development pattern. A score is calculated for each. More specifically, for example, during a baseball attack, the predicted action development pattern is basically limited to strikeout / four-ball / error / single strike / double strike / triple strike / home run. If there are runners, you can also predict the points that fluctuate in each development pattern.
- the score calculation unit 503 can predict a change in score due to play or competition development in real time by calculating a score for each of such patterns.
- the score calculation unit 503 may calculate the expected value of the score at that time based on the occurrence probability of each development pattern.
- the occurrence probability may be statistically calculated, for example, a batting rate for each player in baseball or a shot success rate for each position in the pitch in soccer.
- the score calculation part 503 may employ
- the reasonable probability of occurrence can be determined as appropriate depending on, for example, the type of sport and the user's preference, but can be at least a probability that the user seems to be able to happen, or a probability that is not astronomically low. .
- FIG. 5 is a graph illustrating an example of a score calculated in an embodiment of the present disclosure.
- the score calculated by the score calculation unit 530 is shown in a baseball game (from a play ball to a game set).
- a base score that rises with the progress (time or inning) of the game is set.
- the base score expresses that the weight of each play increases because the conclusion comes closer to the end of a game such as baseball or soccer.
- the elapsed time and inning of the game can be included in the variable V20 related to the context in which the action occurs in the above example.
- the score calculation unit 503 calculates a portion corresponding to the base score by multiplying the elapsed time by a positive coefficient.
- the example shown in the figure is a baseball game between the T team and the G team. Since it is known that the user (video viewer) is a fan of T team, the score calculation unit 503 stands on the T team side and calculates the score. After the playball (start of the game), especially when there is no movement in the game, the calculated score substantially matches the base score. If the T team takes 2 points first (T2-0G), the score will rise due to the T team victory (victory / defeat V23) that is expected to result, and the first threshold (THRESHOLD 1) will be raised. Exceed. For example, the server 200 that has detected such an increase in score provides information for outputting a notification “CHECK IT OUT!” To a user who is viewing another program on the television 100 during the subsequent section P1. , It may be transmitted to the television 100.
- Team G scored 7 points at a time and reversed (T2-7G), and the team went down and predicted that Team T would lose.
- the server 200 temporarily stops the notification of “CHECK IT OUT!” To the user.
- the score rises again due to, for example, a situation where a batter with a high batting rate stands in the batting order (player V21), and exceeds the first threshold.
- the server 200 resumes notification of “CHECK IT OUT!” To the user.
- Team T scored 4 points at this chance, but did not reverse (T6-7G), where the score once declined.
- the server 200 continues to notify the user “CHECK IT OUT!”.
- Team T has another chance to score, with a one-point difference.
- the base score is high because the game is at the end of the game, and although it is inferior as described above, the score does not decrease because it is a one-point difference.
- the T team win is predicted with a high probability, so the score is the highest so far and exceeds the second threshold (THRESHOLD 2).
- the server 200 that has detected such an increase in the score may change the notification to the user to an expression that strongly recommends viewing such as “DON'T MISS IT!” During the subsequent section P3.
- the T team succeeded in reversing (T8-7G), and the game set (the end of the game) was reached with the victory of the T team.
- the user A who has a relatively long time watches the video of the game in accordance with the recommendation by the notification in the sections P1, P2, and P3, and moves the game (change in score). ).
- the user B who has not had much time can watch the video of the game in the section P3 in response to the strong recommendation by the notification, and can see only the end of the reverse victory without missing.
- the score calculation unit 503 is standing on the T team side and calculating the score. Therefore, for example, when it is known that the user is a fan of the G team, the score calculation unit 503 may calculate a score that changes contrary to the illustrated example, for example.
- FIG. 6 is a diagram illustrating an example in which the score calculated in the embodiment of the present disclosure is applied to the caption of a video.
- a caption 1101 is displayed on the video 1100.
- the score calculated by the score calculation unit 503 is treated as a “miracle score”. This score is calculated, for example, with the intention of giving a high score to “a very rare action (playing or acting)”. More specifically, a high score is awarded when a player wins by reversing a large point difference or when an unusual record is achieved.
- Caption 1101 contains the text “Can you witness the miracle?” And the text indicating that the predicted score for a home run is 98 (100 in this example is the maximum and very high). Including. By displaying such a caption 1101, the user can know how wonderful the play that may occur from now on may be, for example, whether or not to continue watching the video. Can be judged appropriately.
- FIG. 7 is a diagram illustrating an example in which the score calculated in an embodiment of the present disclosure is applied to a game caption or system.
- a caption 1201 is displayed on the video image 1200 of the game.
- the score calculated by the score calculation unit 503 is handled as a “miracle score”.
- the caption 1201 is accompanied by text indicating that the miracle score for a home run is 82 (100 is also the maximum value in this example, which is quite high), and in that case, a bonus of 50% experience value increase is obtained in the game play.
- the text 1203 indicating that is included.
- the score calculated in the present embodiment may be calculated for an action that occurs in a virtual space, and the status in the virtual space may change according to the calculated score.
- the action is a sport play or performance, but the example of the action in the embodiment of the present disclosure is not limited thereto.
- the score calculated in the embodiment of the present disclosure may be useful if it is an action that is subject to some evaluation or appreciation even if it is not a sport.
- a score may be calculated in the same manner and used for generating a highlight video.
- FIG. 8 is a block diagram illustrating a hardware configuration example of the information processing apparatus according to the embodiment of the present disclosure.
- the illustrated information processing apparatus 900 can realize, for example, the server, the television, the recorder, or the camera in the above-described embodiment.
- the information processing apparatus 900 includes a CPU (Central Processing unit) 901, a ROM (Read Only Memory) 903, and a RAM (Random Access Memory) 905.
- the information processing apparatus 900 may include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, a drive 921, a connection port 923, and a communication device 925.
- the information processing apparatus 900 may include an imaging device 933 and a sensor 935 as necessary.
- the information processing apparatus 900 may include a processing circuit such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array) instead of or in addition to the CPU 901.
- DSP Digital Signal Processor
- ASIC Application Specific Integrated Circuit
- FPGA Field-Programmable Gate Array
- the CPU 901 functions as an arithmetic processing device and a control device, and controls all or a part of the operation in the information processing device 900 according to various programs recorded in the ROM 903, the RAM 905, the storage device 919, or the removable recording medium 927.
- the ROM 903 stores programs and calculation parameters used by the CPU 901.
- the RAM 905 primarily stores programs used in the execution of the CPU 901, parameters that change as appropriate during the execution, and the like.
- the CPU 901, the ROM 903, and the RAM 905 are connected to each other by a host bus 907 configured by an internal bus such as a CPU bus. Further, the host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.
- PCI Peripheral Component Interconnect / Interface
- the input device 915 is a device operated by the user, such as a mouse, a keyboard, a touch panel, a button, a switch, and a lever.
- the input device 915 may be, for example, a remote control device that uses infrared rays or other radio waves, or may be an external connection device 929 such as a mobile phone that supports the operation of the information processing device 900.
- the input device 915 includes an input control circuit that generates an input signal based on information input by the user and outputs the input signal to the CPU 901. The user operates the input device 915 to input various data and instruct processing operations to the information processing device 900.
- the output device 917 is configured by a device capable of notifying the acquired information to the user using a sense such as vision, hearing, or touch.
- the output device 917 can be, for example, a display device such as an LCD (Liquid Crystal Display) or an organic EL (Electro-Luminescence) display, an audio output device such as a speaker or headphones, or a vibrator.
- the output device 917 outputs the result obtained by the processing of the information processing device 900 as video such as text or image, sound such as sound or sound, or vibration.
- the storage device 919 is a data storage device configured as an example of a storage unit of the information processing device 900.
- the storage device 919 includes, for example, a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device.
- the storage device 919 stores, for example, programs executed by the CPU 901 and various data, and various data acquired from the outside.
- the drive 921 is a reader / writer for a removable recording medium 927 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and is built in or externally attached to the information processing apparatus 900.
- the drive 921 reads information recorded on the attached removable recording medium 927 and outputs the information to the RAM 905.
- the drive 921 writes a record in the attached removable recording medium 927.
- the connection port 923 is a port for connecting a device to the information processing apparatus 900.
- the connection port 923 can be, for example, a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface) port, or the like.
- the connection port 923 may be an RS-232C port, an optical audio terminal, an HDMI (registered trademark) (High-Definition Multimedia Interface) port, or the like.
- the communication device 925 is a communication interface configured with, for example, a communication device for connecting to the communication network 931.
- the communication device 925 can be, for example, a communication card for LAN (Local Area Network), Bluetooth (registered trademark), Wi-Fi, or WUSB (Wireless USB).
- the communication device 925 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), or a modem for various communication.
- the communication device 925 transmits and receives signals and the like using a predetermined protocol such as TCP / IP with the Internet and other communication devices, for example.
- the communication network 931 connected to the communication device 925 is a network connected by wire or wireless, and may include, for example, the Internet, a home LAN, infrared communication, radio wave communication, satellite communication, or the like.
- the imaging device 933 uses various members such as an imaging element such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device), and a lens for controlling the formation of a subject image on the imaging element. It is an apparatus that images a real space and generates a captured image.
- the imaging device 933 may capture a still image or may capture a moving image.
- the sensor 935 is various sensors such as an acceleration sensor, an angular velocity sensor, a geomagnetic sensor, an illuminance sensor, a temperature sensor, an atmospheric pressure sensor, or a sound sensor (microphone).
- the sensor 935 acquires information about the state of the information processing apparatus 900 itself, such as the posture of the information processing apparatus 900, and information about the surrounding environment of the information processing apparatus 900, such as brightness and noise around the information processing apparatus 900, for example. To do.
- the sensor 935 may include a GPS receiver that receives a GPS (Global Positioning System) signal and measures the latitude, longitude, and altitude of the device.
- GPS Global Positioning System
- Each component described above may be configured using a general-purpose member, or may be configured by hardware specialized for the function of each component. Such a configuration can be appropriately changed according to the technical level at the time of implementation.
- Embodiments of the present disclosure function, for example, as an information processing apparatus (such as a server, a television, a recorder, or a camera) as described above, a system, an information processing method executed by the information processing apparatus or system, and an information processing apparatus. And a non-transitory tangible medium on which the program is recorded.
- an information processing apparatus such as a server, a television, a recorder, or a camera
- a variable acquisition unit that acquires a first variable related to the content of an action and a second variable related to a context in which the action occurs;
- An information processing apparatus comprising: a score calculation unit that calculates a score for evaluating the action based on the first variable and the second variable.
- the variable acquisition unit acquires the first variable related to the content of the action that has not been completed for each of the development patterns of the action predicted at the time, The information processing apparatus according to (1), wherein the score calculation unit calculates the score for each development pattern.
- the score calculation unit calculates an expected value of the score based on each occurrence probability of the development pattern.
- the information processing apparatus calculates the score for each user attribute of the content related to the action.
- the action includes a plurality of types of sports, The information processing apparatus according to any one of (1) to (8), wherein the score calculation unit calculates a score common to each type of sport.
- the information processing apparatus according to (9), wherein the score calculation unit corrects the score according to the popularity of each type of sport.
- (11) The information processing apparatus according to (10), wherein the score calculation unit corrects the score upward for a sport with low popularity.
- the second variable includes a variable related to an actor that has executed the action.
- the action occurs in the battle, The information processing apparatus according to any one of (1) to (12), wherein the second variable includes a variable related to a progress of the battle until the action occurs. (14) The action occurs in the battle, The information processing apparatus according to any one of (1) to (13), wherein the second variable includes a variable related to a result of the battle that is derived by the occurrence of the action. (15) obtaining a first variable relating to the content of the action and a second variable relating to the context in which the action occurs; A processor calculating a score for evaluating the action based on the first variable and the second variable.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Computer Security & Cryptography (AREA)
- Astronomy & Astrophysics (AREA)
- General Physics & Mathematics (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Human Computer Interaction (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Closed-Circuit Television Systems (AREA)
- Image Analysis (AREA)
Abstract
Description
1.システム構成
2.スコア算出処理の位置づけ
3.スコア算出処理
4.算出されるスコアの例
5.応用例
6.ハードウェア構成
7.補足
図2は、本開示の一実施形態に係るシステムの構成例を示す図である。図2を参照すると、システム10は、テレビ100と、レコーダ150と、サーバ200と、カメラ300とを含む。
図3は、本開示の一実施形態におけるスコア算出処理の位置づけについて説明するための図である。図3には、スコア算出処理500の前段階の処理として、画像/センサデータ解析処理410、タグ入力処理420、およびメディアログ解析処理430が示されている。また、図3には、スコア算出処理500の後段階の処理として、配信/視聴/再生映像選択処理440、キャプション生成処理450、およびハイライト生成処理460が示されている。以下、本実施形態において算出されるスコアの意義を理解しやすくするために、これらの前段階および後段階の処理について、さらに説明する。
映像/センサデータ解析処理410は、例えば、カメラ300によって撮影された映像や、スポーツのプレーヤ(アクションを実行するアクター)や用具に装着されたセンサによって検出されるセンサデータを解析する処理である。例えば、映像解析によって、映像の被写体や、被写体の位置、姿勢、動きなどを検出することが可能である。また、加速度センサや角速度センサなどのセンサデータを解析することによって、プレーヤや用具に発生した衝撃やそれらの姿勢、動きなどを検出することが可能である。映像/センサデータ解析処理410では、このような映像やセンサデータの解析によって、例えば映像に捉えられたアクション(スポーツのプレーや演技)の内容に関する変量を取得することができる。映像やセンサデータの解析は、例えばテレビ100、レコーダ150、サーバ200、またはカメラ300を実現する情報処理装置が備えるCPU(Central Processing unit)などのプロセッサによって実行される。
配信/視聴/再生映像選択処理440は、例えばサーバ200がテレビ100またはレコーダ150に配信する映像や、テレビ100で視聴する映像、レコーダ150が再生してテレビ100から出力させる映像を、スコア算出処理500で算出されたスコアに基づいて決定する処理である。配信/視聴/再生映像選択処理440は、例えば、カメラ300a,300bから並行してサーバ200に映像が提供されている場合や、サーバ200から2つ以上の映像が並行してテレビ100に配信されている場合、レコーダ150に2つ以上の映像が録画されている場合などのように、選択可能な映像が複数ある場合に実行されうる。
図4は、本開示の一実施形態におけるスコア算出処理の構成要素について説明するための図である。図4には、スコア算出処理500の構成要素として、変量取得部501、スコア算出部503、スコア出力部505、および係数取得部507が示されている。さらに、図4には、付加的な構成要素として、係数DB509と、係数算出部511とが示されている。例えば、変量取得部501、スコア算出部503、スコア出力部505、係数取得部507、および係数算出部511は、スコア算出処理500を実行する装置(例えば、サーバ200、テレビ100、レコーダ150、またはカメラ300)のプロセッサがプログラムに従って動作することによって実現される。また、係数DB509は、例えば上記の装置のメモリまたはストレージによって実現される。
以上で説明したようなスコア算出処理500では、まだ発生していないアクション(スポーツのプレーや演技)について、それが発生した場合のスコアを予測することが可能である。より具体的には、この場合、変量取得部501は、未完了のアクションの内容に関する変量V10を、その時点で予測されるアクションの展開パターンのそれぞれについて取得し、スコア算出部503は、展開パターンごとにスコアを算出する。より具体的には、例えば、野球の攻撃中であれば、予測されるアクションの展開パターンは基本的には三振/四球/エラー/単打/二塁打/三塁打/ホームランに限定される。ランナーがいる状況であれば、それぞれの展開パターンで変動するポイントも予測できる。また、例えば、サッカーの攻撃中であれば、アクションの展開パターンとしてシュート(成功)/シュート(失敗)/ボールを奪われるなどを予測することができる。スコア算出部503は、このようなパターンのそれぞれについてスコアを算出することによって、プレーや競技の展開によるスコアの変動をリアルタイムで予測することができる。
図5は、本開示の一実施形態において算出されるスコアの一例を示すグラフである。図5に示された例では、野球の試合(プレイボールからゲームセットまで)に、スコア算出部530が算出したスコアが示されている。図示された例では、試合の経過(時間、またはイニング)に従って上昇するベーススコアが設定されている。ベーススコアは、例えば、野球やサッカーなどの試合の終盤になるにつれて決着が近づくため、個々のプレーの重みが増すことを表現している。試合の経過時間やイニングは、上記の例ではアクションが発生するコンテキストに関する変量V20に含まれうる。例えば、スコア算出部503は、経過時間に正の係数をかけることによってベーススコアにあたる部分を算出する。
図6は、本開示の一実施形態において算出されたスコアを映像のキャプションに応用した例を示す図である。図示された例では、映像1100に、キャプション1101が表示されている。図示された例において、スコア算出部503が算出するスコアは、「ミラクルスコア」として扱われている。このスコアは、例えば、「なかなか起きないが、起こったら素晴らしいアクション(プレーや演技)」に高いスコアを与えることを意図して算出される。より具体的には、大きな点差を逆転して勝利した場合や、珍しい記録を達成した場合などに、高いスコアが与えられる。キャプション1101は、「あなたは奇跡を目撃できるか?」というテキストと、ホームランの場合に予測されるスコアが98(この例では100が最大値であり、きわめて高い)であることを示すテキストとを含む。このようなキャプション1101が表示されることによって、ユーザは、これから発生する可能性があるプレーが、どの程度素晴らしいものになる可能性があるかを知ることができ、例えば映像の視聴を続けるか否かを適切に判断することができる。
次に、図8を参照して、本開示の実施形態に係る情報処理装置のハードウェア構成について説明する。図8は、本開示の実施形態に係る情報処理装置のハードウェア構成例を示すブロック図である。図示された情報処理装置900は、例えば、上記の実施形態におけるサーバ、テレビ、レコーダ、またはカメラなどを実現しうる。
本開示の実施形態は、例えば、上記で説明したような情報処理装置(サーバ、テレビ、レコーダ、またはカメラなど)、システム、情報処理装置またはシステムで実行される情報処理方法、情報処理装置を機能させるためのプログラム、およびプログラムが記録された一時的でない有形の媒体を含みうる。
(1)アクションの内容に関する第1の変量と、前記アクションが発生するコンテキストに関する第2の変量とを取得する変量取得部と、
前記第1の変量および第2の変量に基づいて前記アクションを評価するスコアを算出するスコア算出部と
を備える情報処理装置。
(2)前記変量取得部は、未完了の前記アクションの内容に関する前記第1の変量を、その時点で予測される前記アクションの展開パターンのそれぞれについて取得し、
前記スコア算出部は、前記展開パターンごとに前記スコアを算出する、前記(1)に記載の情報処理装置。
(3)前記スコア算出部は、前記展開パターンのそれぞれの発生確率に基づいて、前記スコアの期待値を算出する、前記(2)に記載の情報処理装置。
(4)前記スコア算出部は、合理的な発生確率を有する前記展開パターンについて算出された前記スコアのうち、最も高いものを前記スコアの予測値として算出する、前記(2)に記載の情報処理装置。
(5)過去のアクションにおける前記第1の変量および前記第2の変量と、前記過去のアクションに対するオーディエンスの反応との関係に基づいて算出される係数を取得する係数取得部をさらに備え、
前記スコア算出部は、前記係数に基づいて前記スコアを算出する、前記(1)~(4)のいずれか1項に記載の情報処理装置。
(6)前記係数は、前記過去のアクションに対するメディアの活性化の程度に応じて算出される、前記(5)に記載の情報処理装置。
(7)前記スコア算出部は、前記アクションを実行するアクターの属性ごとに前記スコアを算出する、前記(1)~(6)のいずれか1項に記載の情報処理装置。
(8)前記スコア算出部は、前記アクションに関するコンテンツのユーザの属性ごとに前記スコアを算出する、前記(1)~(7)のいずれか1項に記載の情報処理装置。
(9)前記アクションは、複数の種類のスポーツを含み、
前記スコア算出部は、各種類のスポーツに共通のスコアを算出する、前記(1)~(8)のいずれか1項に記載の情報処理装置。
(10)前記スコア算出部は、各種類のスポーツのポピュラリティに応じて前記スコアを補正する、前記(9)に記載の情報処理装置。
(11)前記スコア算出部は、前記ポピュラリティが低いスポーツについて前記スコアを上方修正する、前記(10)に記載の情報処理装置。
(12)前記第2の変量は、前記アクションを実行したアクターに関する変量を含む、前記(1)~(11)のいずれか1項に記載の情報処理装置。
(13)前記アクションは、対戦の中で発生し、
前記第2の変量は、前記アクションが発生するまでの前記対戦の経過に関する変量を含む、前記(1)~(12)のいずれか1項に記載の情報処理装置。
(14)前記アクションは、対戦の中で発生し、
前記第2の変量は、前記アクションが発生したことによって導かれる前記対戦の結果に関する変量を含む、前記(1)~(13)のいずれか1項に記載の情報処理装置。
(15)アクションの内容に関する第1の変量と、前記アクションが発生するコンテキストに関する第2の変量とを取得することと、
プロセッサが、前記第1の変量および第2の変量に基づいて前記アクションを評価するスコアを算出することと
を含む情報処理方法。
(16)アクションの内容に関する第1の変量と、前記アクションが発生するコンテキストに関する第2の変量とを取得する機能と、
前記第1の変量および第2の変量に基づいて前記アクションを評価するスコアを算出する機能と
をコンピュータに実現させるためのプログラム。
100 テレビ
150 レコーダ
200 サーバ
300 カメラ
500 スコア算出処理
501 変量取得部
503 スコア算出部
505 スコア出力部
507 係数取得部
509 係数DB
511 係数算出部
Claims (16)
- アクションの内容に関する第1の変量と、前記アクションが発生するコンテキストに関する第2の変量とを取得する変量取得部と、
前記第1の変量および第2の変量に基づいて前記アクションを評価するスコアを算出するスコア算出部と
を備える情報処理装置。 - 前記変量取得部は、未完了の前記アクションの内容に関する前記第1の変量を、その時点で予測される前記アクションの展開パターンのそれぞれについて取得し、
前記スコア算出部は、前記展開パターンごとに前記スコアを算出する、請求項1に記載の情報処理装置。 - 前記スコア算出部は、前記展開パターンのそれぞれの発生確率に基づいて、前記スコアの期待値を算出する、請求項2に記載の情報処理装置。
- 前記スコア算出部は、合理的な発生確率を有する前記展開パターンについて算出された前記スコアのうち、最も高いものを前記スコアの予測値として採用する、請求項2に記載の情報処理装置。
- 過去のアクションにおける前記第1の変量および前記第2の変量と、前記過去のアクションに対するオーディエンスの反応との関係に基づいて算出される係数を取得する係数取得部をさらに備え、
前記スコア算出部は、前記係数に基づいて前記スコアを算出する、請求項1に記載の情報処理装置。 - 前記係数は、前記過去のアクションに対するメディアの活性化の程度に応じて算出される、請求項5に記載の情報処理装置。
- 前記スコア算出部は、前記アクションを実行するアクターの属性ごとに前記スコアを算出する、請求項1に記載の情報処理装置。
- 前記スコア算出部は、前記アクションに関するコンテンツのユーザの属性ごとに前記スコアを算出する、請求項1に記載の情報処理装置。
- 前記アクションは、複数の種類のスポーツを含み、
前記スコア算出部は、各種類のスポーツに共通のスコアを算出する、請求項1に記載の情報処理装置。 - 前記スコア算出部は、各種類のスポーツのポピュラリティに応じて前記スコアを補正する、請求項9に記載の情報処理装置。
- 前記スコア算出部は、前記ポピュラリティが低いスポーツについて前記スコアを上方修正する、請求項10に記載の情報処理装置。
- 前記第2の変量は、前記アクションを実行したアクターに関する変量を含む、請求項1に記載の情報処理装置。
- 前記アクションは、対戦の中で発生し、
前記第2の変量は、前記アクションが発生するまでの前記対戦の経過に関する変量を含む、請求項1に記載の情報処理装置。 - 前記アクションは、対戦の中で発生し、
前記第2の変量は、前記アクションが発生したことによって導かれる前記対戦の結果に関する変量を含む、請求項1に記載の情報処理装置。 - アクションの内容に関する第1の変量と、前記アクションが発生するコンテキストに関する第2の変量とを取得することと、
プロセッサが、前記第1の変量および第2の変量に基づいて前記アクションを評価するスコアを算出することと
を含む情報処理方法。 - アクションの内容に関する第1の変量と、前記アクションが発生するコンテキストに関する第2の変量とを取得する機能と、
前記第1の変量および第2の変量に基づいて前記アクションを評価するスコアを算出する機能と
をコンピュータに実現させるためのプログラム。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2016564711A JP6673221B2 (ja) | 2014-12-18 | 2015-09-25 | 情報処理装置、情報処理方法、およびプログラム |
US15/528,568 US10873777B2 (en) | 2014-12-18 | 2015-09-25 | Information processing device and information processing method to calculate score for evaluation of action |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014-255984 | 2014-12-18 | ||
JP2014255984 | 2014-12-18 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016098415A1 true WO2016098415A1 (ja) | 2016-06-23 |
Family
ID=56126317
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2015/077129 WO2016098415A1 (ja) | 2014-12-18 | 2015-09-25 | 情報処理装置、情報処理方法、およびプログラム |
Country Status (3)
Country | Link |
---|---|
US (1) | US10873777B2 (ja) |
JP (1) | JP6673221B2 (ja) |
WO (1) | WO2016098415A1 (ja) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018060715A1 (en) * | 2016-09-29 | 2018-04-05 | Sports Information Services Limited | Automated production of live events |
JP2018124969A (ja) * | 2017-02-03 | 2018-08-09 | 富士ゼロックス株式会社 | 複数のメディアセグメントを備えるメディアファイルのサマリを生成する方法、プログラム、およびメディア分析デバイス |
JPWO2018070414A1 (ja) * | 2016-10-11 | 2019-06-24 | 富士通株式会社 | 運動認識装置、運動認識プログラムおよび運動認識方法 |
WO2021140827A1 (ja) * | 2020-01-10 | 2021-07-15 | ジャングルX株式会社 | 情報処理装置、情報処理方法及び情報処理プログラム |
WO2021171470A1 (ja) * | 2020-02-27 | 2021-09-02 | 富士通株式会社 | 情報処理プログラム、装置、及び方法 |
JPWO2021186645A1 (ja) * | 2020-03-18 | 2021-09-23 | ||
WO2022215116A1 (ja) * | 2021-04-05 | 2022-10-13 | 富士通株式会社 | 情報処理プログラム、装置、及び方法 |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10229324B2 (en) * | 2015-12-24 | 2019-03-12 | Intel Corporation | Video summarization using semantic information |
CN107911736B (zh) * | 2017-11-21 | 2020-05-12 | 广州华多网络科技有限公司 | 直播互动方法及*** |
US10943125B1 (en) * | 2018-12-13 | 2021-03-09 | Facebook, Inc. | Predicting highlights for media content |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002259720A (ja) * | 2001-03-02 | 2002-09-13 | Internatl Business Mach Corp <Ibm> | コンテンツ要約システム、映像要約システム、ユーザ端末、要約映像生成方法、要約映像受信方法、およびプログラム |
JP2002300518A (ja) * | 2001-03-29 | 2002-10-11 | Nippon Hoso Kyokai <Nhk> | ダイジェスト番組の作成方法、装置および記憶媒体 |
JP2003333500A (ja) * | 2002-05-15 | 2003-11-21 | Ricoh Co Ltd | パーソナルダイジェスト配信システム |
JP2005251018A (ja) * | 2004-03-05 | 2005-09-15 | Ricoh Co Ltd | 映像コンテンツ重要度解析システム |
JP2013258450A (ja) * | 2012-06-11 | 2013-12-26 | Nec Casio Mobile Communications Ltd | 情報処理装置 |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4712339B2 (ja) * | 2004-10-13 | 2011-06-29 | 株式会社リコー | 場面判定装置、場面判定方法、その方法をコンピュータに実行させるプログラム、情報配信装置、および情報配信システム |
US8782681B2 (en) * | 2007-03-08 | 2014-07-15 | The Nielsen Company (Us), Llc | Method and system for rating media and events in media based on physiological data |
US20090262137A1 (en) * | 2008-01-10 | 2009-10-22 | Walker Jay S | Systems and methods for presenting prediction in a broadcast |
JP2010266880A (ja) | 2010-06-23 | 2010-11-25 | Sony Corp | 携帯端末装置、情報処理方法、及びプログラム |
US9262481B1 (en) * | 2013-09-24 | 2016-02-16 | Microstrategy Incorporated | Determining popular venues |
-
2015
- 2015-09-25 WO PCT/JP2015/077129 patent/WO2016098415A1/ja active Application Filing
- 2015-09-25 US US15/528,568 patent/US10873777B2/en active Active
- 2015-09-25 JP JP2016564711A patent/JP6673221B2/ja active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002259720A (ja) * | 2001-03-02 | 2002-09-13 | Internatl Business Mach Corp <Ibm> | コンテンツ要約システム、映像要約システム、ユーザ端末、要約映像生成方法、要約映像受信方法、およびプログラム |
JP2002300518A (ja) * | 2001-03-29 | 2002-10-11 | Nippon Hoso Kyokai <Nhk> | ダイジェスト番組の作成方法、装置および記憶媒体 |
JP2003333500A (ja) * | 2002-05-15 | 2003-11-21 | Ricoh Co Ltd | パーソナルダイジェスト配信システム |
JP2005251018A (ja) * | 2004-03-05 | 2005-09-15 | Ricoh Co Ltd | 映像コンテンツ重要度解析システム |
JP2013258450A (ja) * | 2012-06-11 | 2013-12-26 | Nec Casio Mobile Communications Ltd | 情報処理装置 |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11202105B2 (en) | 2016-09-29 | 2021-12-14 | Sports Information Services Limited | Automated production of live events |
GB2569740A (en) * | 2016-09-29 | 2019-06-26 | Sports Information Services Ltd | Automated production of live events |
WO2018060715A1 (en) * | 2016-09-29 | 2018-04-05 | Sports Information Services Limited | Automated production of live events |
EP4262225A3 (en) * | 2016-09-29 | 2023-11-15 | Sports Information Services Limited | Method and apparatus for an automated production of a stream of video data representing live events |
AU2020281157B2 (en) * | 2016-09-29 | 2022-08-11 | Sports Information Services Limited | Automated production of live events |
GB2569740B (en) * | 2016-09-29 | 2022-03-30 | Sports Information Services Ltd | Automated production of live events |
JPWO2018070414A1 (ja) * | 2016-10-11 | 2019-06-24 | 富士通株式会社 | 運動認識装置、運動認識プログラムおよび運動認識方法 |
JP2018124969A (ja) * | 2017-02-03 | 2018-08-09 | 富士ゼロックス株式会社 | 複数のメディアセグメントを備えるメディアファイルのサマリを生成する方法、プログラム、およびメディア分析デバイス |
WO2021140827A1 (ja) * | 2020-01-10 | 2021-07-15 | ジャングルX株式会社 | 情報処理装置、情報処理方法及び情報処理プログラム |
JP2021111139A (ja) * | 2020-01-10 | 2021-08-02 | ジャングルX株式会社 | 情報処理装置、情報処理方法及び情報処理プログラム |
JPWO2021171470A1 (ja) * | 2020-02-27 | 2021-09-02 | ||
WO2021171470A1 (ja) * | 2020-02-27 | 2021-09-02 | 富士通株式会社 | 情報処理プログラム、装置、及び方法 |
JP7400937B2 (ja) | 2020-02-27 | 2023-12-19 | 富士通株式会社 | 情報処理プログラム、装置、及び方法 |
WO2021186645A1 (ja) * | 2020-03-18 | 2021-09-23 | 富士通株式会社 | 情報処理プログラム、装置、及び方法 |
JPWO2021186645A1 (ja) * | 2020-03-18 | 2021-09-23 | ||
JP7444238B2 (ja) | 2020-03-18 | 2024-03-06 | 富士通株式会社 | 情報処理プログラム、装置、及び方法 |
WO2022215116A1 (ja) * | 2021-04-05 | 2022-10-13 | 富士通株式会社 | 情報処理プログラム、装置、及び方法 |
Also Published As
Publication number | Publication date |
---|---|
US10873777B2 (en) | 2020-12-22 |
US20170280182A1 (en) | 2017-09-28 |
JPWO2016098415A1 (ja) | 2017-09-28 |
JP6673221B2 (ja) | 2020-03-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6673221B2 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
JP7049428B2 (ja) | 動画配信装置、動画配信方法、動画配信プログラム | |
JP7080208B2 (ja) | 複数のメディアストリームの処理 | |
US9278288B2 (en) | Automatic generation of a game replay video | |
JP6610689B2 (ja) | 情報処理装置、情報処理方法及び記録媒体 | |
US9005030B2 (en) | System and method for sharing score experiences | |
KR20140103033A (ko) | 라이브 이벤트들을 위한 증강 현실 | |
CN108905095B (zh) | 运动员比赛状态评估方法和设备 | |
US8483435B2 (en) | Information processing device, information processing system, information processing method, and information storage medium | |
WO2022006118A1 (en) | Modifying computer simulation video template based on feedback | |
US11749309B2 (en) | Information processor, information processing method, and program | |
EP2923485B1 (en) | Automated filming process for sport events | |
JP2014517746A (ja) | オンラインゲームの中での社会的な交流 | |
WO2020017354A1 (ja) | 情報処理装置、情報処理方法、及びプログラム | |
US20230013988A1 (en) | Enhancing viewing experience by animated tracking of user specific key instruments | |
US11577163B2 (en) | Computer server, a method and computer program product | |
US20210402309A1 (en) | Generating video clip of computer simulation from multiple views | |
JP2022047497A (ja) | ライブイベントストリームの途中で予測を行う方法及びデータ処理システム | |
CN116096466A (zh) | 用于指导用户玩游戏的***和方法 | |
CN116234614A (zh) | 通过可穿戴设备的逐场预测 | |
CN112883883A (zh) | 信息提示方法、装置、介质、眼镜及程序产品 | |
US20240087072A1 (en) | Live event information display method, system, and apparatus | |
TW201421985A (zh) | 場景片段傳輸系統、方法及記錄媒體 | |
US20210402299A1 (en) | Selection of video template based on computer simulation metadata | |
US20200179802A1 (en) | A system and method for implementing a computerized game |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15869623 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2016564711 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15528568 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 15869623 Country of ref document: EP Kind code of ref document: A1 |