CN107924690A - 用于促进扩展场景中的导航的方法、装置和*** - Google Patents

用于促进扩展场景中的导航的方法、装置和*** Download PDF

Info

Publication number
CN107924690A
CN107924690A CN201680050719.3A CN201680050719A CN107924690A CN 107924690 A CN107924690 A CN 107924690A CN 201680050719 A CN201680050719 A CN 201680050719A CN 107924690 A CN107924690 A CN 107924690A
Authority
CN
China
Prior art keywords
interest
area
visual field
navigation information
big visual
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201680050719.3A
Other languages
English (en)
Other versions
CN107924690B (zh
Inventor
安东尼·洛朗
樊尚·阿洛姆
马克西米林·贝洛
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
InterDigital CE Patent Holdings SAS
Original Assignee
Thomson Licensing SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing SAS filed Critical Thomson Licensing SAS
Publication of CN107924690A publication Critical patent/CN107924690A/zh
Application granted granted Critical
Publication of CN107924690B publication Critical patent/CN107924690B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/003Navigation within 3D models or images
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/32Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier
    • G11B27/322Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on separate auxiliary tracks of the same or an auxiliary record carrier used signal is digitally coded
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/10Geometric effects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/34Indicating arrangements 
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44204Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213Monitoring of end-user related data
    • H04N21/44222Analytics of user selections, e.g. selection of programs or purchase activity
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Remote Sensing (AREA)
  • Architecture (AREA)
  • Geometry (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Processing Or Creating Images (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Image Generation (AREA)

Abstract

一种促进朝向视频内容的扩展场景中的感兴趣区域导航的方法、装置和***包括:确定时间线,所述时间线包括与视频内容中的至少一个感兴趣区域有关的信息;以及在当前显示的视频内容中显示视觉指示器,所述视觉指示器指示为了显示所述至少一个感兴趣区域而在视频内容中移动的方向。在本公开原理的一个实施例中,时间线附加到所述内容并携带与感兴趣的区域有关的随着时间而演变的信息。渲染器处理所述时间线,并且使用可用手段(比如图形表示、触觉信息或者几种手段的组合)向用户提供导航信息。

Description

用于促进扩展场景中的导航的方法、装置和***
技术领域
本公开的原理总体上涉及通过视频内容的导航(navigate),并且更具体地涉及促进视频内容中的扩展场景中的导航。
背景技术
最近,可用的大视场内容(高达360°)有所增长。这些内容对于在公共设备(例如头戴式显示器、Oculus Rift、智能眼镜、PC屏幕、平板电脑、智能电话等)上观看内容的用户来讲可能并不是完全可见的。这意味着在某个特定时刻,用户可能只能查看内容的一部分,并且往往只能查看对故事情节不重要的部分内容。尽管用户可以通过诸如头部移动、鼠标移动、触摸屏幕、语音等各种手段在内容中进行导航,但是如果所述内容表示事件发生在不同时刻和不同位置的动态场景(例如电影)的内容,则用户不确定是否会看到场景的相关部分,并且如果重要事件/有趣的序列出现在他/她的当前视场之外,则用户可能会错过这些内容。
发明内容
本公开原理解决了现有技术的这些和其他缺点和缺点,本公开原理针对用于促进宽场景中的导航并将用户的注意力引导到感兴趣区域的方法、装置和***。
在本公开原理的一个实施例中,时间线附加到内容并携带与感兴趣区域有关的随时间演变的信息,并且更具体地涉及与位置或对象ID、相关联的最优视点和兴趣级别有关的信息。在设备上,渲染器(3D引擎、视频播放器...)处理所述时间线,并且使用可用手段(图形表示、触觉信息或者几种手段的组合)向用户提供导航信息。
附图说明
通过考虑结合附图的以下详细描述,可以容易地理解本发明的教导,在附图中:
图1描绘了用户查看全部可用内容的一部分的图形表示;
图2描绘了根据本公开原理实施例的由对象ID标识的两个ROI的时序图/时间线;
图3描绘了根据本公开原理实施例的用于提供图2的时序图中的信息的代表性语法;
图4示出了根据本公开原理实施例简化的图3的语法的版本;
图5描绘了根据本公开原理实施例的由对象形状标识的两个ROI的时序图/时间线;
图6描绘了根据本公开原理实施例的用于提供图5的时序图中的信息的代表性语法;
图7描绘了内容的场景中的一部分,其中在屏幕的边缘处包括条,以向用户指示用户应当沿哪个方向观看/导航场景;
图8描绘了根据本公开原理实施例的渲染器的高级框图;以及
图9描绘了根据本公开原理实施例的用于促进向视频内容的扩展场景中的感兴趣区域进行导航的方法的流程图。
为了便于理解,视情况使用相同的参考标记来指代对于附图来说共同的相同元素。附图没有按比例绘制的,并且为了清楚起见可以扩展或减少一个或多个特征。
具体实施方式
本公开原理的实施例有利地提供了促进在宽场景中导航并将用户的注意力引导至感兴趣区域的方法、装置和***。尽管主要在特定视觉指示器并且沿水平方向引导用户的视图的场景下描述了本公开原理,但是本公开原理的特定实施例不应被认为限制本发明的范围。本领域技术人员将理解并且通过本公开原理的教导被告知,本公开原理的概念可以有利地应用于可以用于将用户的注意力引导到视频内容的任何部分的任何视觉指示器,而无论是沿水平、垂直和/或对角线方向。
本公开原理的实施例旨在促进用户在宽渲染场景中朝着最佳视点(OV1)的位置导航,其中用户将能够观看可能是用户感兴趣的场景的感兴趣区域(ROI)。也就是说,在给定时刻,用户可能对场景的几个部分感兴趣。同样地,根据本公开原理的实施例,重要的是,通知用户同时存在几个ROI。这样的ROI可以具有各种兴趣程度,并且因此本公开原理的这些实施例包括将排名与对兴趣级别(LOI)加以表示的每个ROI相关联。ROI的LOI也可以随着时间而演变。对于所有用户来说各种LOI值可以是相同的,或者相对于用户之前表示感兴趣的ROI类型来说进行个性化。在本公开原理的各种实施例中,通过使用LOI,用户可以决定向ROI导航,或者相反地,用户可以估计此刻不感兴趣。
图1描绘了用户查看全部可用内容的一部分的图形表示。也就是说,在图1中,黑色矩形轮廓框表示用户视场内的全部内容的一部分。本公开原理的实施例通过例如具有在每个时刻指示什么是ROI(例如,虚拟对象标识符或形状坐标)以及相关联的OV的时间线来在虚拟场景中结合ROI和OV的概念。也就是说,根据本公开原理的实施例,最佳视点(OV)的概念包括引导用户注意的位置和方向(方位)。在各种实施例中,OV可以与ROI重合。在备选实施例中,OV可以包括使得用户能够同时观看2个不同ROI的权衡方向。此外,在本公开原理的各种实施例中,OV可以随时间演变并且和与ROI相关的变化相关联。在这样的实施例中,可以设想不提供所有坐标,而是在具有从一个坐标移动到另一个坐标的手段的情况下(即要遵循的轨迹),仅提供坐标的子集。例如,提供第一位置、最后位置和中间位置以及要应用的轨迹函数。在这样的实施例中,轨迹可以包括两点之间的直线、贝塞尔曲线等。渲染器然后将对所有中间位置进行插值以确定最终位置。根据本公开原理的这种解决方案显著地减少了要提供的数据量。这种解决方案也可以应用于所述方向。
根据本公开原理的各种实施例,对于作为2D内容的视频,ROI可以是例如矩形,并且坐标可以包括矩形的左上角和右下角。对于3D场景,可以将ROI同化为边界框或更复杂的形状。在这样的实施例中,提供给渲染器的信息可以包括形状的坐标,或者备选地可以包括对象或对象/形状组的标识符。
在本公开原理的实施例中,提供对象/对象组ID与2D或3D形状的坐标之间的主要区别在于:在第一种情况中,只需提供一次ID和指示ROI何时被激活以及激活多长时间的时序信息(开始时间和持续时间);而在第二种情况中,每当ROI改变时(可能在每一帧处)必须向渲染器提供坐标和时间信息。在第一种情况中,渲染器在每个时刻都知道对象相对于用户的查看和/或相关场景中的虚拟位置的位置。在第二种情况中,上面提出的用于减少数据量的解决方案也可以用于对ROI轨迹进行建模。
在本公开原理的各种实施例中,所述内容可以在一些时段不包含任何感兴趣的事件,并且在这种情况中,不存在与ROI有关的信息。在备选实施例中,可以同时存在几个ROI。在这样的实施例中,ROI可以具有不同的兴趣级别(LOI)。根据本公开原理的实施例,可以使用视觉、触觉消息或消息的组合来用信号通知同时的ROI和相关联的LOI。
即在本公开原理的各种实施例中,LOI包括与ROI有关的数据,并且通常指示与和ROI相关联的兴趣级别有关的信息。LOI可以包括例如在一个实施例中具有例如5的值范围的离散信息,其中1指示ROI中的低兴趣级别并且5指高兴趣级别,或者反之亦然。应该注意的是,根据本公开原理的各种实施例,LOI可随时间演变。
根据本公开原理,与OV、ROI和LOI有关的信息是预先确定的,并且在ROI在内容中变得激活之前对于渲染器是可用的。也就是说,根据本公开原理,渲染器能够开始向用户通知要呈现的ROI。一个目标是使用户能够有足够的时间预测将ROI带入用户视场所需的移动,从而不会错过ROI中的序列的开始或感兴趣的对象。在本公开原理的一个实施例中,在准备步骤期间,渲染器可以使用与序列的开始时间相关联的LOI。在备选实施例中,渲染器可以使用全局LOI。全局LOI值可以包括LOI随时间所取的值的均值或由内容创建者设置的值。全局LOI提供了可能与序列的第一LOI值相反的序列的全局兴趣级别的概述,该LOI值不一定代表整个序列。
图2描绘了根据本公开原理实施例的由对象ID标识的两个ROI的时序图/时间线。在图2的示例中,第一ROI的与其相关的全局LOI为3。第一ROI也具有在所有时刻都相同的OV,并且其等于OV11。在图2的示例中,第一ROI具有随时间演变并且在时间戳t1和t1l2处取值LOI11和LOI12的相关联的LOI。
另外在图2的实施例中,第二ROI的全局LOI为4。图2的第二ROI的OV随时间演变并取值OV21和OV22,并且LOI随时间演变并且在时间戳t2和t2l2处取值LOI21和LOI22。如上所述,ROI是由其ID标识的对象。
图3描绘了根据本公开原理实施例的用于提供图2的时序图中的信息的代表性语法。也就是说,图3的语法可以用来提供图2的示例的信息,以供渲染器使用,这将在下文描述。
根据本公开原理的各种实施例,图3的语法可以降低效率。更具体地,图4示出了根据本公开原理实施例简化的图3的语法的版本。也就是说,在图4的简化语法中,已经去除了一些无用信息。例如,在图4的简化语法中,在对于相同字段(例如,LOI)中接连出现的值(例如LOI11和LOI12)没有设置stopTime。在图4的简化语法中,stopTime等于后续值的startTime(LOI11的stopTime=LOI12的startTime)或者母元素的stopTime(LOI12的stopTime=ROI的stopTime)。
图5描绘了根据本公开原理实施例的由对象形状标识的两个ROI的时序图/时间线。在图5的示例中,第一ROI的与其相关的全局LOI为3。第一ROI也具有在所有时刻都相同的OV,并且等于OV11。在图5的示例中,第一ROI具有随时间演变并且在时间戳t1和t1l2处取值LOI11和LOI12的相关联的LOI。
另外在图5的实施例中,第二ROI的全局LOI为4。图2的第二ROI的OV随时间演变并取值OV21和OV22,并且LOI随时间演变并且在时间戳t2和t2l2处取值LOI21和LOI22。如上所述,在两种情况下,ROI都由其提供位置的形状(即相对于另一个对象)来标识。
图2和图5的示例之间的区别在于:在通过形状来标识ROI的图5中,存在对ROI的坐标加以指示的字段,这在图2的示例中不需要。在图5的示例中,第一ROI(1)取3个不同的位置(坐标11、坐标12和坐标13),并且第二ROI(2)取2个不同的位置(坐标21和坐标22)。
图6描绘了根据本公开原理实施例的用于提供图5的时序图中的信息的代表性语法。也就是说,图6的语法可以用来提供图5的示例的信息,以供渲染器使用,这将在下文描述。
根据本公开原理的各种实施例,如以上参考图4所描述的,可以针对效率简化图6的语法。
在本公开原理的各种实施例中,将时序图(时间线)的信息提供给诸如视频播放器、3D引擎、处理引擎等的渲染设备。渲染器分析时序图中的信息并确定:
·ROI何时将变得激活并且持续多久?
·它的位置是什么?
·它的OV是什么,它是如何随时间演变的?
·它的全局LOI是什么以及LOI如何随时间演变
渲染器使用本领域已知的技术知晓渲染场景中用户的当前姿态和方向。本文将不描述这样的技术。这样的信息使得能够确定用户为了到达OV应该遵循的路径以及用户为了查看ROI应该看向的方向。
在本公开原理的各种实施例中,可以提醒用户看向特定方向,或者更具体地可以使用视觉指示器将导航信息引导至用户,所述视觉指示器例如是以下中的至少一个或其组合:
·指南针;
·位于屏幕边缘的向要跟随的方向移动的条;
·在通过对象ID来标识ROI的场景的情况下,可以使用表示ROI的资产或资产组的缩影;
·示出了一个或多个要遵循的路径(以达到ROI的最佳视点位置)的足迹符号,其中与OV相关的感兴趣对象的类型相关联的颜色模式。
例如,图7根据本公开原理的实施例描绘了内容的场景中的一部分,其中在屏幕的边缘处包括条,以向用户指示用户应当沿哪个方向观看/导航场景。更具体地说,在图7中,屏幕的左下边缘的条指示用户遵循左下方向。尽管在图7的实施例中,将条描绘为位于内容的左下方,指引用户沿左方向观看,在本公开原理的备选实施例中,用户的注意力可以指向视频内容的任何部分并且在任何方向视频内容使用本原则的视觉指示器。
在本公开原理的各种实施例中,用户可以具有选择想要的导航指示器的类型的选项。例如,在本公开原理的一个实施例中,可以用几个视觉指示器选项来填充下拉菜单,并且用户可以选择要使用的视觉指示器。
此外根据本公开原理的各种实施例,距离的概念可以与本公开原理的可视指示器相关联。更具体地,在一个实施例中,相距期望的ROI的距离可以通过视觉指示器的大小来表示,或者可以使用视觉指示器的颜色来表示(即,当远离ROI时是红色,当靠近时是绿色,反之亦然)。
在本公开原理的一个实施例中,渲染器在准备步骤中在ROI开始处于激活状态之前几秒钟显示导航信息。如前所述,由于准备步骤,用户可以预期他/她向ROI/OV的移动,使得在显示/处理兴趣序列之前用户的视点包括ROI。在这样的实施例中,这样的准备步骤可以进一步包括颜色代码、特定符号、倒数计时或另一种指示用户已经处理准备步骤的指示器。准备步骤的参数(例如持续时间)可以是硬编码的或由用户设置的。
在本公开原理的备选实施例中,渲染器可以在准备步骤期间向用户显示与全局LOI有关的信息。与内容的一部分的特定LOI有关的信息可以使用与LOI的值相关的特定符号或颜色代码呈现给用户。这种约定可以是硬编码的或者可以是用户可选择的参数。
在存在多个同时OV的实施例中,可以展现每个OV的指示。备选地,可以显示最有兴趣的一个或多个的指示。在其中呈现对多于一个OV的指示的实施例中,用户具有决定遵循哪个指示器来查看期望的ROI的能力。同时的ROI的数量可以是硬编码的,也可以是用户可以设置的参数。
在本公开原理的各种实施例中,与本公开原理的实施例相关联的数据可以存储在类似于字幕组件的元数据组件中。
图8描绘了根据本公开原理实施例的用于实现本公开原理的特征的渲染器的高级别框图。图8的渲染器包括处理器810以及用于存储控制程序、指令、软件、视频内容、数据等的存储器820。处理器810与诸如电源、时钟电路、高速缓冲存储器等的常规支持电路830、以及有助于执行存储在存储器820中的软件例程的电路协同工作。因此,可以设想,本文作为软件过程讨论的一些处理步骤可以在硬件内实现,例如,实现为与处理器810协作以执行各种步骤的电路。图8的渲染器还包括形成与渲染器通信的各种功能元件之间的接口的输入输出电路840。
尽管图8的渲染器780被描绘为编程为执行根据本发明的各种控制功能的通用计算机,但是本公开原理可以在硬件中实现,例如实现为专用集成电路(ASIC)。因此,本文描述的处理步骤旨在被广泛地解释为被软件、硬件或其组合等同地执行。
图9描绘了根据本公开原理实施例的用于促进向视频内容的扩展场景中的感兴趣区域进行导航的方法的流程图。方法900开始于步骤902,在步骤902期间,确定包括与视频内容中的至少一个感兴趣区域有关的信息在内的时间线。然后,方法900可前进至步骤904。
在步骤904处,在当前正在显示的视频内容的一部分中显示视觉指示器,所述视觉指示器指示为了显示感兴趣区域而在视频内容中的移动的方向。方法900然后可以可选地包括上述本公开原理的任何其他特征。例如,方法900还可以包括如上所述对OV和LOI的确定。

Claims (16)

1.一种在渲染大视场内容的一部分时确定导航信息的方法,其特征在于,所述方法包括:
获得表示附加到所述大视场内容的时间线的数据,所述时间线包括与所述视频内容中的至少一个感兴趣区域有关的激活信息;
根据所述大视场内容的所述部分和所述至少一个感兴趣区域,确定导航信息。
2.根据权利要求1所述的方法,其中,所述至少一个感兴趣区域中的至少一个感兴趣区域还与所述时间线中的至少一个兴趣级别相关联,并且还根据所述至少一个兴趣级别来确定导航信息。
3.根据权利要求1或2所述的方法,其中,所述至少一个感兴趣区域还与用于渲染所述感兴趣区域的最优视点相关联,并且还根据所述最优视点确定导航信息。
4.根据权利要求1至3之一所述的方法,其中,所述大视场内容是三维场景,并且根据所述3D场景的对象来确定所述至少一个感兴趣区域中的感兴趣区域。
5.根据权利要求1至3之一所述的方法,其中,所述大视场内容是视频,并且根据对所述视频的二维部分的形状的描述确定所述至少一个感兴趣区域中的感兴趣区域。
6.根据权利要求1至5之一所述的方法,其中,所述导航信息是要覆盖在所述大视场内容的所述部分上的视觉信息。
7.根据权利要求1至6之一所述的方法,其中,所述导航信息包括触觉效果。
8.一种配置为在渲染大视场内容的一部分时确定导航信息的装置,其特征在于,所述装置包括至少一个处理器,所述处理器配置为:
获得表示附加到所述大视场内容的时间线的数据,所述时间线包括与所述视频内容中的至少一个感兴趣区域有关的激活信息;
根据所述大视场内容的所述部分和所述至少一个感兴趣区域,确定导航信息。
9.根据权利要求8所述的装置,其中,所述至少一个感兴趣区域中的至少一个感兴趣区域还与所述时间线中的至少一个兴趣级别相关联,并且所述至少一个处理器还配置为根据所述至少一个兴趣级别来确定导航信息。
10.根据权利要求8或9所述的装置,其中,所述至少一个感兴趣区域还与用于渲染所述感兴趣区域的最优视点相关联,并且所述至少一个处理器还配置为根据所述最优视点确定导航信息。
11.根据权利要求8至10之一所述的装置,其中,所述大视场内容是三维场景,并且根据所述3D场景的对象来确定所述至少一个感兴趣区域中的感兴趣区域。
12.根据权利要求8至10之一所述的装置,其中,所述大视场内容是视频,并且根据对所述视频的二维部分的形状的描述确定所述至少一个感兴趣区域中的感兴趣区域。
13.根据权利要求8至12之一所述的装置,其中,所述导航信息是要覆盖在所述大视场内容的所述部分上的视觉信息。
14.根据权利要求8至12之一所述的装置,其中,所述导航信息是触觉效果。
15.一种大视场内容渲染器,所述大视场内容渲染器配置为在渲染大视场内容的一部分时渲染导航信息,其特征在于,所述大视场内容渲染器包括至少一个处理器,所述处理器配置为根据权利要求1至6之一所述的方法来确定所述导航信息。
16.根据权利要求15所述的大视场内容渲染器,还包括触觉效果器,并且所述导航信息所包括的所述导航信息是触觉效果,所述至少一个处理器还配置为在所述触觉效果器上渲染所述触觉效果。
CN201680050719.3A 2015-09-02 2016-08-26 用于促进扩展场景中的导航的方法、装置和*** Active CN107924690B (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP15306349 2015-09-02
EP15306349.0 2015-09-02
PCT/EP2016/070181 WO2017036953A1 (en) 2015-09-02 2016-08-26 Method, apparatus and system for facilitating navigation in an extended scene

Publications (2)

Publication Number Publication Date
CN107924690A true CN107924690A (zh) 2018-04-17
CN107924690B CN107924690B (zh) 2021-06-25

Family

ID=54251458

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680050719.3A Active CN107924690B (zh) 2015-09-02 2016-08-26 用于促进扩展场景中的导航的方法、装置和***

Country Status (7)

Country Link
US (2) US11699266B2 (zh)
EP (1) EP3345184A1 (zh)
JP (1) JP6879479B2 (zh)
KR (1) KR102551239B1 (zh)
CN (1) CN107924690B (zh)
TW (1) TW201710646A (zh)
WO (1) WO2017036953A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114786051A (zh) * 2022-03-31 2022-07-22 北京百度网讯科技有限公司 一种视频渲染方法、装置、电子设备及存储介质

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10402043B1 (en) * 2017-08-10 2019-09-03 Gopro, Inc. Systems and methods for indicating highlights within spherical videos
KR102390208B1 (ko) * 2017-10-17 2022-04-25 삼성전자주식회사 멀티미디어 데이터를 전송하는 방법 및 장치
US10270967B1 (en) 2017-11-30 2019-04-23 Gopro, Inc. Auto-recording of media data
US10721510B2 (en) 2018-05-17 2020-07-21 At&T Intellectual Property I, L.P. Directing user focus in 360 video consumption
US10482653B1 (en) 2018-05-22 2019-11-19 At&T Intellectual Property I, L.P. System for active-focus prediction in 360 video
US10827225B2 (en) 2018-06-01 2020-11-03 AT&T Intellectual Propety I, L.P. Navigation for 360-degree video streaming
US10419738B1 (en) 2018-06-14 2019-09-17 Telefonaktiebolaget Lm Ericsson (Publ) System and method for providing 360° immersive video based on gaze vector information
US10841662B2 (en) 2018-07-27 2020-11-17 Telefonaktiebolaget Lm Ericsson (Publ) System and method for inserting advertisement content in 360° immersive video

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102244807A (zh) * 2010-06-02 2011-11-16 微软公司 自适应视频变焦
CN102369497A (zh) * 2009-03-31 2012-03-07 派尔高公司 用于在视频显示器中创建目标区域的方法和设备
CN102611872A (zh) * 2011-01-19 2012-07-25 株式会社理光 基于感兴趣区域动态检测的场景影像转换***和方法
CN104185078A (zh) * 2013-05-20 2014-12-03 华为技术有限公司 视频监控处理方法、装置及***
CN104685893A (zh) * 2012-06-29 2015-06-03 弗兰霍菲尔运输应用研究公司 视频数据流概念技术

Family Cites Families (450)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5644694A (en) * 1994-12-14 1997-07-01 Cyberflix Inc. Apparatus and method for digital movie production
US5714997A (en) * 1995-01-06 1998-02-03 Anderson; David P. Virtual reality television system
US20150244969A1 (en) * 1995-09-07 2015-08-27 Kba2, Inc. System and method for recording and distributing video
US6040841A (en) * 1996-08-02 2000-03-21 Microsoft Corporation Method and system for virtual cinematography
US5977978A (en) * 1996-11-13 1999-11-02 Platinum Technology Ip, Inc. Interactive authoring of 3D scenes and movies
US6324335B1 (en) * 1996-11-29 2001-11-27 Sony Corporation Editing system and editing method
US6392651B1 (en) * 1997-04-03 2002-05-21 Intergraph Corporation Interactive timeline visualization
EP0920014A4 (en) * 1997-04-12 2002-12-04 Sony Corp EDITING DEVICE AND EDITING METHOD
WO1999059026A2 (en) 1998-05-13 1999-11-18 Infinite Pictures Inc. Panoramic movies which simulate movement through multidimensional space
US6366296B1 (en) * 1998-09-11 2002-04-02 Xerox Corporation Media browser using multimodal analysis
US6636238B1 (en) * 1999-04-20 2003-10-21 International Business Machines Corporation System and method for linking an audio stream with accompanying text material
JP3695217B2 (ja) * 1999-04-30 2005-09-14 オムロン株式会社 画像処理装置及び画像入力装置
US6563529B1 (en) * 1999-10-08 2003-05-13 Jerry Jongerius Interactive system for displaying detailed view and direction in panoramic images
US20010034607A1 (en) * 2000-02-04 2001-10-25 Perschbacher Walter F. System for providing automated real estate services
US6636210B1 (en) * 2000-03-03 2003-10-21 Muse Corporation Method and system for auto-navigation in a three dimensional viewing environment
US20060015925A1 (en) * 2000-03-28 2006-01-19 Gotuit Media Corp Sales presentation video on demand system
JP4325071B2 (ja) * 2000-04-07 2009-09-02 ソニー株式会社 デジタルビデオ再生方法及びデジタルビデオ再生装置
KR20040041082A (ko) * 2000-07-24 2004-05-13 비브콤 인코포레이티드 멀티미디어 북마크와 비디오의 가상 편집을 위한 시스템및 방법
US20100064596A1 (en) * 2000-07-31 2010-03-18 Bowsher M William Three-Dimensional Documentation Lab Chamber
US6762757B1 (en) * 2001-05-18 2004-07-13 Autodesk, Inc. Using hardware devices to generate modified geometry objects based on instructions provided by extension objects
US6768486B1 (en) * 2001-05-18 2004-07-27 Autodesk, Inc. Modifying subobjects of geometry objects based on per-subobject objects
US20060036513A1 (en) * 2001-09-26 2006-02-16 Jerry Whatley System and method for providing property improvements
US7747655B2 (en) * 2001-11-19 2010-06-29 Ricoh Co. Ltd. Printable representations for time-based media
US6585521B1 (en) * 2001-12-21 2003-07-01 Hewlett-Packard Development Company, L.P. Video indexing based on viewers' behavior and emotion feedback
US7411594B2 (en) * 2002-01-15 2008-08-12 Canon Kabushiki Kaisha Information processing apparatus and method
JP3971346B2 (ja) 2002-06-24 2007-09-05 株式会社東芝 動画像再生装置、スケジュール・データ、動画像再生方法、及びプログラム
US7248231B2 (en) * 2002-11-05 2007-07-24 Speakeasy, Llc Integrated information presentation system with environmental controls
US7823058B2 (en) * 2002-12-30 2010-10-26 The Board Of Trustees Of The Leland Stanford Junior University Methods and apparatus for interactive point-of-view authoring of digital video content
US8307273B2 (en) * 2002-12-30 2012-11-06 The Board Of Trustees Of The Leland Stanford Junior University Methods and apparatus for interactive network sharing of digital video content
US20040183826A1 (en) * 2003-02-20 2004-09-23 Taylor Jaime R. Method for providing images of real property in conjunction with their directional orientation
US10151599B1 (en) * 2003-03-13 2018-12-11 Pamala Meador Interactive virtual reality tour
JP4332364B2 (ja) * 2003-04-04 2009-09-16 ソニー株式会社 映像記録システム,映像記録方法
JP3824163B2 (ja) * 2003-04-04 2006-09-20 ソニー株式会社 記録制御装置および記録制御方法、プログラム、並びに記録媒体
JP2005149409A (ja) * 2003-11-19 2005-06-09 Canon Inc 画像再生方法及び装置
US7672864B2 (en) * 2004-01-09 2010-03-02 Ricoh Company Ltd. Generating and displaying level-of-interest values
US20160267720A1 (en) * 2004-01-30 2016-09-15 Electronic Scripting Products, Inc. Pleasant and Realistic Virtual/Augmented/Mixed Reality Experience
JP2007065928A (ja) * 2005-08-30 2007-03-15 Toshiba Corp 情報記憶媒体、情報処理方法、情報転送方法、情報再生方法、情報再生装置、情報記録方法、情報記録装置、及びプログラム
KR20070086037A (ko) * 2004-11-12 2007-08-27 목3, 인크. 장면 간 전환 방법
US20060106625A1 (en) * 2004-11-12 2006-05-18 Brown Barry J System and method for coordinating real estate transactions through a global communications network
US7440626B2 (en) * 2004-12-02 2008-10-21 Mitsubishi Electric Research Laboratories, Inc. Image transcoding
WO2006076566A1 (en) * 2005-01-12 2006-07-20 Erik Vicars Method and system for documenting assets with certified digital images
US8279119B2 (en) * 2005-01-19 2012-10-02 The Charles Stark Draper Laboratory, Inc. Systems and methods for transparency mapping using multipath signals
WO2006103744A1 (ja) * 2005-03-29 2006-10-05 Fujitsu Limited 映像管理システム
AU2006277225B2 (en) * 2005-08-09 2011-06-09 Panasonic Corporation Recording medium, playback apparatus, method and program
US7623900B2 (en) * 2005-09-02 2009-11-24 Toshiba Medical Visualization Systems Europe, Ltd. Method for navigating a virtual camera along a biological object with a lumen
JP2007133489A (ja) * 2005-11-08 2007-05-31 Sony Corp 仮想空間画像表示方法、装置、仮想空間画像表示プログラム及び記録媒体
US8130260B2 (en) * 2005-11-09 2012-03-06 Johns Hopkins University System and method for 3-dimensional display of image data
US7823068B2 (en) * 2006-02-28 2010-10-26 Mark Anthony Ogle Cowtan Internet-based, dual-paned virtual tour presentation system with orientational capabilities and versatile tabbed menu-driven area for multi-media content delivery
US7567844B2 (en) * 2006-03-17 2009-07-28 Honeywell International Inc. Building management system
US11317057B2 (en) * 2006-03-18 2022-04-26 Steve H MCNELLEY Advanced telepresence environments
US8564543B2 (en) * 2006-09-11 2013-10-22 Apple Inc. Media player with imaged based browsing
US8253731B2 (en) * 2006-11-27 2012-08-28 Designin Corporation Systems, methods, and computer program products for home and landscape design
US20080126206A1 (en) * 2006-11-27 2008-05-29 Trf Systems, Inc. Providing advertising to buyers of real estate utilizing virtual tours
US20080168350A1 (en) * 2007-01-05 2008-07-10 Jones David N Method and system for movie karaoke
US20080252640A1 (en) * 2007-04-13 2008-10-16 Jeffrey Williams Systems and methods for interactive real estate viewing
US20080294663A1 (en) * 2007-05-14 2008-11-27 Heinley Brandon J Creation and management of visual timelines
US7990394B2 (en) * 2007-05-25 2011-08-02 Google Inc. Viewing and navigating within panoramic images, and applications thereof
DE102007034010A1 (de) * 2007-07-20 2009-01-22 Dallmeier Electronic Gmbh & Co. Kg Verfahren und Vorrichtung zur Bearbeitung von Videodaten
JP2009026177A (ja) * 2007-07-23 2009-02-05 Clarion Co Ltd 表示制御装置、表示制御方法および制御プログラム
US20100122208A1 (en) * 2007-08-07 2010-05-13 Adam Herr Panoramic Mapping Display
US8803881B2 (en) * 2007-09-26 2014-08-12 Autodesk, Inc. Navigation system for a 3D virtual scene
US10504285B2 (en) * 2007-09-26 2019-12-10 Autodesk, Inc. Navigation system for a 3D virtual scene
US9703369B1 (en) * 2007-10-11 2017-07-11 Jeffrey David Mullen Augmented reality video game systems
US20090106671A1 (en) * 2007-10-22 2009-04-23 Olson Donald E Digital multimedia sharing in virtual worlds
US20150046537A1 (en) * 2007-11-21 2015-02-12 Vdoqwest, Inc., A Delaware Corporation Retrieving video annotation metadata using a p2p network and copyright free indexes
IL189251A0 (en) * 2008-02-05 2008-11-03 Ehud Gal A manned mobile platforms interactive virtual window vision system
US20100005424A1 (en) * 2008-03-05 2010-01-07 Neelakantan Sundaresan Virtual world system supporting a consumer experience
US8125481B2 (en) * 2008-03-21 2012-02-28 Google Inc. Lightweight three-dimensional display
US9661275B2 (en) * 2008-06-13 2017-05-23 Scott Gordon Dynamic multi-perspective interactive event visualization system and method
US20090315766A1 (en) * 2008-06-19 2009-12-24 Microsoft Corporation Source switching for devices supporting dynamic direction information
CN103324386A (zh) * 2008-08-22 2013-09-25 谷歌公司 移动设备上的三维环境中的导航
EP2890149A1 (en) * 2008-09-16 2015-07-01 Intel Corporation Systems and methods for video/multimedia rendering, composition, and user-interactivity
ES2881884T3 (es) * 2008-09-30 2021-11-30 Cognisens Inc Método y dispositivo para evaluar, entrenar y mejorar habilidades perceptivo-cognitivas de individuos
US20100115459A1 (en) * 2008-10-31 2010-05-06 Nokia Corporation Method, apparatus and computer program product for providing expedited navigation
US8422825B1 (en) * 2008-11-05 2013-04-16 Hover Inc. Method and system for geometry extraction, 3D visualization and analysis using arbitrary oblique imagery
US8493408B2 (en) * 2008-11-19 2013-07-23 Apple Inc. Techniques for manipulating panoramas
JP5099451B2 (ja) * 2008-12-01 2012-12-19 アイシン精機株式会社 車両周辺確認装置
US8294766B2 (en) * 2009-01-28 2012-10-23 Apple Inc. Generating a three-dimensional model using a portable electronic device recording
US20100232504A1 (en) * 2009-03-13 2010-09-16 The State of Oregon acting by and through the State Board of Higher Education on behalf of the Supporting region-of-interest cropping through constrained compression
EP2409289A1 (en) * 2009-03-16 2012-01-25 Tomtom Belgium N.V. Method for updating digital maps
US20100241525A1 (en) * 2009-03-18 2010-09-23 Microsoft Corporation Immersive virtual commerce
US20140240313A1 (en) * 2009-03-19 2014-08-28 Real Time Companies Computer-aided system for 360° heads up display of safety/mission critical data
US8769421B2 (en) * 2009-04-30 2014-07-01 Apple Inc. Graphical user interface for a media-editing application with a segmented timeline
US9728006B2 (en) * 2009-07-20 2017-08-08 Real Time Companies, LLC Computer-aided system for 360° heads up display of safety/mission critical data
US9639983B2 (en) * 2009-07-22 2017-05-02 Behr Process Corporation Color selection, coordination and purchase system
US20110052144A1 (en) * 2009-09-01 2011-03-03 2Cimple, Inc. System and Method for Integrating Interactive Call-To-Action, Contextual Applications with Videos
US9766089B2 (en) * 2009-12-14 2017-09-19 Nokia Technologies Oy Method and apparatus for correlating and navigating between a live image and a prerecorded panoramic image
US8803951B2 (en) * 2010-01-04 2014-08-12 Disney Enterprises, Inc. Video capture system control using virtual cameras for augmented reality
US20110210962A1 (en) * 2010-03-01 2011-09-01 Oracle International Corporation Media recording within a virtual world
US8566348B2 (en) * 2010-05-24 2013-10-22 Intersect Ptp, Inc. Systems and methods for collaborative storytelling in a virtual space
WO2011149961A2 (en) * 2010-05-24 2011-12-01 Intersect Ptp, Inc. Systems and methods for identifying intersections using content metadata
US20110310227A1 (en) 2010-06-17 2011-12-22 Qualcomm Incorporated Mobile device based content mapping for augmented reality environment
US9892546B2 (en) * 2010-06-30 2018-02-13 Primal Space Systems, Inc. Pursuit path camera model method and system
US9232257B2 (en) * 2010-09-22 2016-01-05 Thomson Licensing Method for navigation in a panoramic scene
WO2012040134A2 (en) * 2010-09-24 2012-03-29 The Research Foundation Of State University Of New York Illumination information icon for enriching navigable panoramic street view maps
US8723888B2 (en) * 2010-10-29 2014-05-13 Core Wireless Licensing, S.a.r.l. Method and apparatus for determining location offset information
US8576276B2 (en) * 2010-11-18 2013-11-05 Microsoft Corporation Head-mounted display device which provides surround video
US20120176525A1 (en) * 2011-01-12 2012-07-12 Qualcomm Incorporated Non-map-based mobile interface
US8745499B2 (en) * 2011-01-28 2014-06-03 Apple Inc. Timeline search and index
US20120194547A1 (en) * 2011-01-31 2012-08-02 Nokia Corporation Method and apparatus for generating a perspective display
SG192884A1 (en) * 2011-02-21 2013-09-30 Univ Singapore Apparatus, system, and method for annotation of media files with sensor data
WO2012122269A2 (en) * 2011-03-07 2012-09-13 Kba2, Inc. Systems and methods for analytic data gathering from image providers at an event or geographic location
US20120264510A1 (en) * 2011-04-12 2012-10-18 Microsoft Corporation Integrated virtual environment
US8533593B2 (en) * 2011-04-19 2013-09-10 Autodesk, Inc Hierarchical display and navigation of document revision histories
US20120281500A1 (en) * 2011-05-02 2012-11-08 Schlumberger Technology Corporation Interaction with seismic data
WO2012162442A2 (en) * 2011-05-23 2012-11-29 Blu Homes, Inc. Method, apparatus and system for customizing a building via a virtual environment
US9860572B2 (en) * 2011-06-08 2018-01-02 Koninklijke Kpn N.V. Spatially segmented content delivery
US8612426B2 (en) * 2011-06-20 2013-12-17 Conifer Research Llc Systems and methods for arranging participant interview clips for ethnographic research
JP5979499B2 (ja) * 2011-08-11 2016-08-24 パナソニックIpマネジメント株式会社 再生装置、再生方法、集積回路、放送システム、及び放送方法
US20130063558A1 (en) * 2011-09-14 2013-03-14 Motion Analysis Corporation Systems and Methods for Incorporating Two Dimensional Images Captured by a Moving Studio Camera with Actively Controlled Optics into a Virtual Three Dimensional Coordinate System
TWI451283B (zh) * 2011-09-30 2014-09-01 Quanta Comp Inc 事故資訊整合及管理系統及其相關事故資訊整合及管理方法
US9569066B2 (en) * 2011-10-03 2017-02-14 Google Inc. Interface for navigating imagery
US9396401B2 (en) * 2011-11-01 2016-07-19 Aisin Seiki Kabushiki Kaisha Obstacle alarm device
US8438595B1 (en) * 2011-11-04 2013-05-07 General Instrument Corporation Method and apparatus for temporal correlation of content-specific metadata with content obtained from disparate sources
US8839109B2 (en) * 2011-11-14 2014-09-16 Utc Fire And Security Americas Corporation, Inc. Digital video system with intelligent video selection timeline
US20130129308A1 (en) * 2011-11-18 2013-05-23 Keith Stoll Karn Display device with adaptive fast navigation mode
WO2013077236A1 (en) * 2011-11-21 2013-05-30 Canon Kabushiki Kaisha Image coding apparatus, image coding method, image decoding apparatus, image decoding method, and storage medium
US20130142384A1 (en) * 2011-12-06 2013-06-06 Microsoft Corporation Enhanced navigation through multi-sensor positioning
CN103959344B (zh) * 2011-12-20 2017-03-01 英特尔公司 跨越多个设备的增强现实表示
US11232626B2 (en) * 2011-12-21 2022-01-25 Twenieth Century Fox Film Corporation System, method and apparatus for media pre-visualization
US9024970B2 (en) * 2011-12-30 2015-05-05 Here Global B.V. Path side image on map overlay
US8917971B2 (en) * 2011-12-30 2014-12-23 United Video Properties, Inc. Methods and systems for providing relevant supplemental content to a user device
CA2801512A1 (en) * 2012-01-05 2013-07-05 Jeremy Mutton System and method for virtual touring of model homes
US9159364B1 (en) * 2012-01-30 2015-10-13 Google Inc. Aggregation of related media content
JP6065370B2 (ja) * 2012-02-03 2017-01-25 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
US8805158B2 (en) * 2012-02-08 2014-08-12 Nokia Corporation Video viewing angle selection
US9791290B2 (en) * 2012-02-29 2017-10-17 Here Global B.V. Manipulation of user attention with respect to a simulated field of view for geographic navigation via constrained focus on, perspective attraction to, and/or correction and dynamic adjustment of, points of interest
US20140040833A1 (en) * 2012-03-01 2014-02-06 Adobe Systems Incorporated Edge-aware pointer
US20150271570A1 (en) * 2014-03-18 2015-09-24 Vixs Systems, Inc. Audio/video system with interest-based ad selection and methods for use therewith
US20130297706A1 (en) * 2012-05-03 2013-11-07 United Video Properties, Inc. Systems and methods for processing input from a plurality of users to identify a type of media asset segment
GB2501925B (en) * 2012-05-11 2015-04-29 Sony Comp Entertainment Europe Method and system for augmented reality
EP2847711A1 (en) * 2012-05-11 2015-03-18 Max-Planck-Gesellschaft zur Förderung der Wissenschaften e.V. Browsing and 3d navigation of sparse, unstructured digital video collections
US20130311575A1 (en) * 2012-05-16 2013-11-21 United Video Properties, Inc. Systems and methods for receiving multiple user messages that identify a media asset segment position
JP6124517B2 (ja) * 2012-06-01 2017-05-10 任天堂株式会社 情報処理プログラム、情報処理装置、情報処理システム、およびパノラマ動画表示方法
US9367959B2 (en) * 2012-06-05 2016-06-14 Apple Inc. Mapping application with 3D presentation
US20130321400A1 (en) * 2012-06-05 2013-12-05 Apple Inc. 3D Map Views for 3D Maps
US9886794B2 (en) * 2012-06-05 2018-02-06 Apple Inc. Problem reporting in maps
US10127722B2 (en) * 2015-06-30 2018-11-13 Matterport, Inc. Mobile capture visualization incorporating three-dimensional and two-dimensional imagery
US10139985B2 (en) * 2012-06-22 2018-11-27 Matterport, Inc. Defining, displaying and interacting with tags in a three-dimensional model
US20140047371A1 (en) * 2012-08-10 2014-02-13 Smartdrive Systems Inc. Vehicle Event Playback Apparatus and Methods
US9728228B2 (en) * 2012-08-10 2017-08-08 Smartdrive Systems, Inc. Vehicle event playback apparatus and methods
US20140074855A1 (en) * 2012-09-13 2014-03-13 Verance Corporation Multimedia content tags
GB2505912B (en) * 2012-09-14 2015-10-07 Canon Kk Method and device for generating a description file, and corresponding streaming method
KR20180026803A (ko) * 2012-09-18 2018-03-13 브이아이디 스케일, 인크. 타일 및 타일 그룹을 이용한 관심 영역 비디오 코딩
DE102012217152A1 (de) * 2012-09-24 2014-03-27 Robert Bosch Gmbh Benutzerschnittstellenanordnung sowie Computerprogramm
US20140101608A1 (en) * 2012-10-05 2014-04-10 Google Inc. User Interfaces for Head-Mountable Devices
JP5923021B2 (ja) * 2012-10-05 2016-05-24 日本電信電話株式会社 映像視聴履歴解析装置、映像視聴履歴解析方法及び映像視聴履歴解析プログラム
CN104904225B (zh) * 2012-10-12 2019-05-07 佳能株式会社 用于对视频数据进行流传输的方法和相应装置
US10200818B2 (en) * 2012-10-23 2019-02-05 Qualcomm Incorporated Real-time path suggestion for a location-enabled mobile device
JP6064544B2 (ja) * 2012-11-27 2017-01-25 ソニー株式会社 画像処理装置、画像処理方法、プログラム及び端末装置
CA3000969C (en) * 2012-11-28 2021-08-10 Vrsim, Inc. Simulator for skill-oriented training
US9417762B2 (en) * 2013-01-09 2016-08-16 Northrop Grumman Systems Corporation System and method for providing a virtual immersive environment
US20140199050A1 (en) 2013-01-17 2014-07-17 Spherical, Inc. Systems and methods for compiling and storing video with static panoramic background
EP2757013B1 (en) * 2013-01-21 2019-08-14 Volvo Car Corporation Vehicle driver assist arrangement
US20140208239A1 (en) * 2013-01-24 2014-07-24 MyRooms, Inc. Graphical aggregation of virtualized network communication
US9665557B2 (en) * 2013-01-28 2017-05-30 The Boeing Company Panoptic visualization of elements of a complex system using localization of a point on a physical instance of the complex system
US9858245B2 (en) * 2013-01-28 2018-01-02 The Boeing Company Panoptic visualization of elements of a complex system using a model viewer
US9110988B1 (en) * 2013-03-14 2015-08-18 Google Inc. Methods, systems, and media for aggregating and presenting multiple videos of an event
US9776075B2 (en) * 2013-03-15 2017-10-03 Electronic Arts Inc. Systems and methods for indicating events in game video
GB2513303B (en) * 2013-04-16 2017-06-07 Canon Kk Method and device for partitioning an image
US20140313203A1 (en) * 2013-04-19 2014-10-23 KTS Solutions, LLC Virtual Structural Staging System and Method of Use
JP2014215828A (ja) * 2013-04-25 2014-11-17 シャープ株式会社 画像データ再生装置、および視点情報生成装置
CN105408937B (zh) * 2013-05-02 2018-02-13 高通股份有限公司 用于便于计算机视觉应用程序初始化的方法
US10062209B2 (en) * 2013-05-02 2018-08-28 Nintendo Co., Ltd. Displaying an object in a panoramic image based upon a line-of-sight direction
JP2016526343A (ja) * 2013-05-29 2016-09-01 トムソン ライセンシングThomson Licensing メディアコンテンツをナビゲートする装置及び方法
US8966614B2 (en) * 2013-05-31 2015-02-24 University Of Ontario Institute Of Technology Systems, methods, and computer program products for providing video-passwords for user authentication
KR20140141025A (ko) * 2013-05-31 2014-12-10 삼성에스디에스 주식회사 영상 검색 장치 및 방법
JP6228392B2 (ja) 2013-05-31 2017-11-08 任天堂株式会社 パノラマ画像表示プログラム、パノラマ画像表示装置、パノラマ画像表示システム、および、パノラマ画像表示方法
JP6329343B2 (ja) * 2013-06-13 2018-05-23 任天堂株式会社 画像処理システム、画像処理装置、画像処理プログラム、および画像処理方法
EP2816563A1 (en) 2013-06-18 2014-12-24 Nokia Corporation Video editing
US9729765B2 (en) * 2013-06-19 2017-08-08 Drexel University Mobile virtual cinematography system
US9129430B2 (en) * 2013-06-25 2015-09-08 Microsoft Technology Licensing, Llc Indicating out-of-view augmented reality images
US10127721B2 (en) * 2013-07-25 2018-11-13 Hover Inc. Method and system for displaying and navigating an optimal multi-dimensional building model
WO2015014773A1 (en) * 2013-07-29 2015-02-05 Koninklijke Kpn N.V. Providing tile video streams to a client
US9152695B2 (en) * 2013-08-28 2015-10-06 Intelati, Inc. Generation of metadata and computational model for visual exploration system
KR101753200B1 (ko) * 2013-09-09 2017-07-04 엠파이어 테크놀로지 디벨롭먼트 엘엘씨 증강 현실 변경 감지기
CA2924504A1 (en) * 2013-09-13 2015-03-19 Voke Inc. Video production sharing apparatus and method
US9430509B2 (en) 2013-09-16 2016-08-30 Axis Ab Event timeline generation
US9105094B2 (en) * 2013-10-01 2015-08-11 Adobe Systems Incorporated Image layers navigation
US10134296B2 (en) * 2013-10-03 2018-11-20 Autodesk, Inc. Enhancing movement training with an augmented reality mirror
US9501878B2 (en) * 2013-10-16 2016-11-22 Smartdrive Systems, Inc. Vehicle event playback apparatus and methods
US10242400B1 (en) * 2013-10-25 2019-03-26 Appliance Computing III, Inc. User interface for image-based rendering of virtual tours
RU2678481C2 (ru) * 2013-11-05 2019-01-29 Сони Корпорейшн Устройство обработки информации, способ обработки информации и программа
US9979952B2 (en) * 2013-12-13 2018-05-22 Htc Corporation Method of creating a parallax video from a still image
US9728230B2 (en) * 2014-02-20 2017-08-08 International Business Machines Corporation Techniques to bias video thumbnail selection using frequently viewed segments
US20150264296A1 (en) * 2014-03-12 2015-09-17 videoNEXT Federal, Inc. System and method for selection and viewing of processed video
US9230602B2 (en) * 2014-03-17 2016-01-05 Clipcast Technologies, LLC Media clip creation and distribution systems, apparatus, and methods
US9786324B2 (en) * 2014-03-17 2017-10-10 Clipcast Technologies, LLC Media clip creation and distribution systems, apparatus, and methods
US20150271571A1 (en) * 2014-03-18 2015-09-24 Vixs Systems, Inc. Audio/video system with interest-based recommendations and methods for use therewith
US20170182406A1 (en) * 2014-03-21 2017-06-29 Audience Entertainment Llc Adaptive group interactive motion control system and method for 2d and 3d video
JP6040193B2 (ja) * 2014-03-28 2016-12-07 富士フイルム株式会社 3次元方向設定装置および方法並びにプログラム
EP3127322B1 (en) * 2014-04-04 2019-05-08 Red.Com, Llc Video camera with capture modes
US9392212B1 (en) * 2014-04-17 2016-07-12 Visionary Vr, Inc. System and method for presenting virtual reality content to a user
US9430038B2 (en) * 2014-05-01 2016-08-30 Microsoft Technology Licensing, Llc World-locked display quality feedback
US20150324940A1 (en) * 2014-05-07 2015-11-12 Modular North America, LLC 3D Interactive Construction Estimating System
US20150325268A1 (en) * 2014-05-12 2015-11-12 Penthera Partners, Inc. Downloading videos with commercials to mobile devices
US10600245B1 (en) * 2014-05-28 2020-03-24 Lucasfilm Entertainment Company Ltd. Navigating a virtual environment of a media content item
US9779538B2 (en) * 2014-05-28 2017-10-03 Lucasfilm Entertainment Company Ltd. Real-time content immersion system
US9672865B2 (en) * 2014-05-30 2017-06-06 Rovi Guides, Inc. Systems and methods for temporal visualization of media asset content
US9710972B2 (en) * 2014-05-30 2017-07-18 Lucasfilm Entertainment Company Ltd. Immersion photography with dynamic matte screen
US9589354B2 (en) * 2014-06-17 2017-03-07 Chief Architect Inc. Virtual model viewing methods and apparatus
US10724864B2 (en) * 2014-06-17 2020-07-28 Chief Architect Inc. Step detection methods and apparatus
US9626103B2 (en) * 2014-06-19 2017-04-18 BrightSky Labs, Inc. Systems and methods for identifying media portions of interest
WO2015197815A1 (en) * 2014-06-27 2015-12-30 Koninklijke Kpn N.V. Determining a region of interest on the basis of a hevc-tiled video stream
WO2015197818A1 (en) * 2014-06-27 2015-12-30 Koninklijke Kpn N.V. Hevc-tiled video streaming
US10068373B2 (en) * 2014-07-01 2018-09-04 Samsung Electronics Co., Ltd. Electronic device for providing map information
US9420331B2 (en) * 2014-07-07 2016-08-16 Google Inc. Method and system for categorizing detected motion events
US20160026874A1 (en) * 2014-07-23 2016-01-28 Gopro, Inc. Activity identification in video
US10440398B2 (en) * 2014-07-28 2019-10-08 Jaunt, Inc. Probabilistic model to compress images for three-dimensional video
US20160050349A1 (en) * 2014-08-15 2016-02-18 Sony Corporation Panoramic video
US9841870B2 (en) * 2014-08-21 2017-12-12 The Boeing Company Integrated visualization and analysis of a complex system
WO2016029349A1 (en) * 2014-08-26 2016-03-03 Honeywell International Inc. Annotating three-dimensional displays
US10102285B2 (en) * 2014-08-27 2018-10-16 International Business Machines Corporation Consolidating video search for an event
US9269239B1 (en) * 2014-09-22 2016-02-23 Rockwell Collins, Inc. Situational awareness system and method
US9984505B2 (en) * 2014-09-30 2018-05-29 Sony Interactive Entertainment Inc. Display of text information on a head-mounted display
US9563201B1 (en) * 2014-10-31 2017-02-07 State Farm Mutual Automobile Insurance Company Feedback to facilitate control of unmanned aerial vehicles (UAVs)
US9898868B2 (en) * 2014-11-06 2018-02-20 Seiko Epson Corporation Display device, method of controlling the same, and program
KR102332752B1 (ko) * 2014-11-24 2021-11-30 삼성전자주식회사 지도 서비스를 제공하는 전자 장치 및 방법
TWI628613B (zh) * 2014-12-09 2018-07-01 財團法人工業技術研究院 擴增實境方法與系統
US10115149B1 (en) * 2014-12-18 2018-10-30 Amazon Technologies, Inc. Virtual world electronic commerce platform
US10303435B2 (en) * 2015-01-15 2019-05-28 Seiko Epson Corporation Head-mounted display device, method of controlling head-mounted display device, and computer program
US20160225179A1 (en) * 2015-01-29 2016-08-04 Institute Of Environmental Science And Research Limited Three-dimensional visualization of a scene or environment
US10055887B1 (en) * 2015-02-19 2018-08-21 Google Llc Virtual/augmented reality transition system and method
TWI550421B (zh) * 2015-03-06 2016-09-21 視頻搜尋方法與系統
US9558784B1 (en) * 2015-03-24 2017-01-31 Amazon Technologies, Inc. Intelligent video navigation techniques
US20160292511A1 (en) * 2015-03-31 2016-10-06 Gopro, Inc. Scene and Activity Identification in Video Summary Generation
GB201505864D0 (en) * 2015-04-07 2015-05-20 Ipv Ltd Live markers
CN107810531B (zh) * 2015-04-29 2020-11-27 通腾科技股份有限公司 数据处理***
US9536452B2 (en) * 2015-05-13 2017-01-03 Abl Ip Holding Llc System and method to assist users having reduced visual capability utilizing lighting device provided information
US10186012B2 (en) * 2015-05-20 2019-01-22 Gopro, Inc. Virtual lens simulation for video and photo cropping
US9870755B2 (en) * 2015-05-22 2018-01-16 Google Llc Prioritized display of visual content in computer presentations
US9959677B2 (en) * 2015-05-26 2018-05-01 Google Llc Multidimensional graphical method for entering and exiting applications and activities in immersive media
ES2778935T3 (es) * 2015-05-28 2020-08-12 Nokia Technologies Oy Representación de una notificación en una pantalla montada en la cabeza
US10410413B2 (en) * 2015-05-29 2019-09-10 Hover Inc. Image capture for a multi-dimensional building model
US9934608B2 (en) * 2015-05-29 2018-04-03 Hover Inc. Graphical overlay guide for interface
US10075763B2 (en) * 2015-06-05 2018-09-11 Google Llc Video channel categorization schema
US9361011B1 (en) * 2015-06-14 2016-06-07 Google Inc. Methods and systems for presenting multiple live video feeds in a user interface
CN104994256A (zh) * 2015-06-16 2015-10-21 成都西可科技有限公司 一种支持实时视频直播的运动相机
EP3311582A4 (en) * 2015-06-17 2018-10-31 LG Electronics Inc. Display device and operating method thereof
US10078917B1 (en) * 2015-06-26 2018-09-18 Lucasfilm Entertainment Company Ltd. Augmented reality simulation
GB2540129A (en) * 2015-06-29 2017-01-11 Sony Corp Apparatus, method and computer program
US9973711B2 (en) * 2015-06-29 2018-05-15 Amazon Technologies, Inc. Content-based zooming and panning for video curation
GB2539897A (en) * 2015-06-29 2017-01-04 Sony Corp Apparatus, method and computer program
EP3112985A1 (en) * 2015-06-30 2017-01-04 Nokia Technologies Oy An apparatus for video output and associated methods
EP3113470B1 (en) * 2015-07-02 2020-12-16 Nokia Technologies Oy Geographical location visual information overlay
KR101666561B1 (ko) * 2015-07-13 2016-10-24 한국과학기술원 증강 공간 내 부분 공간 획득 시스템 및 방법
US20170053545A1 (en) * 2015-08-19 2017-02-23 Htc Corporation Electronic system, portable display device and guiding device
US10715843B2 (en) * 2015-08-20 2020-07-14 Koninklijke Kpn N.V. Forming one or more tile streams on the basis of one or more video streams
CN108476327B (zh) * 2015-08-20 2021-03-19 皇家Kpn公司 基于媒体流来形成拼块化视频
US10474766B2 (en) * 2015-09-01 2019-11-12 Autodesk, Inc. Playback profiles for simulating construction schedules with three-dimensional (3D) models
EP3832564A1 (en) * 2015-09-03 2021-06-09 Synthro Inc. Systems and techniques for aggregation, display, and sharing of data
US9805567B2 (en) * 2015-09-14 2017-10-31 Logitech Europe S.A. Temporal video streaming and summaries
CA2941893C (en) * 2015-09-14 2020-02-25 The Toronto-Dominion Bank Connected device-based property evaluation
US10299017B2 (en) * 2015-09-14 2019-05-21 Logitech Europe S.A. Video searching for filtered and tagged motion
US9313556B1 (en) * 2015-09-14 2016-04-12 Logitech Europe S.A. User interface for video summaries
US10976178B2 (en) * 2015-09-24 2021-04-13 Apple Inc. Systems and methods for generating an interactive user interface
US20170090196A1 (en) * 2015-09-28 2017-03-30 Deere & Company Virtual heads-up display application for a work machine
EP3360330B1 (en) * 2015-10-08 2021-03-24 Koninklijke KPN N.V. Enhancing a region of interest in video frames of a video stream
US10724874B2 (en) * 2015-10-13 2020-07-28 Here Global B.V. Virtual reality environment responsive to predictive route navigation
US9721611B2 (en) * 2015-10-20 2017-08-01 Gopro, Inc. System and method of generating video from video clips based on moments of interest within the video clips
US10204273B2 (en) * 2015-10-20 2019-02-12 Gopro, Inc. System and method of providing recommendations of moments of interest within video clips post capture
US10049493B1 (en) * 2015-10-22 2018-08-14 Hoyt Architecture Lab, Inc System and methods for providing interaction with elements in a virtual architectural visualization
US9781342B1 (en) * 2015-10-22 2017-10-03 Gopro, Inc. System and method for identifying comment clusters for panoramic content segments
US10536628B2 (en) * 2015-10-23 2020-01-14 Telefonaktiebolaget Lm Ericsson (Publ) Providing camera settings from at least one image/video hosting service
US10962780B2 (en) * 2015-10-26 2021-03-30 Microsoft Technology Licensing, Llc Remote rendering for virtual images
US20170134714A1 (en) * 2015-11-11 2017-05-11 Microsoft Technology Licensing, Llc Device and method for creating videoclips from omnidirectional video
US20170140795A1 (en) * 2015-11-18 2017-05-18 International Business Machines Corporation Intelligent segment marking in recordings
US10623801B2 (en) * 2015-12-17 2020-04-14 James R. Jeffries Multiple independent video recording integration
EP3182252A1 (en) * 2015-12-17 2017-06-21 Alcatel Lucent A method for navigating between navigation points of a 3-dimensional space, a related system and a related device
JP6518582B2 (ja) * 2015-12-21 2019-05-22 株式会社ソニー・インタラクティブエンタテインメント 情報処理装置および操作受付方法
EP3185535A1 (en) * 2015-12-22 2017-06-28 Thomson Licensing Method and apparatus for controlling a discrepant aiming direction of a camera
US20170187770A1 (en) * 2015-12-29 2017-06-29 Facebook, Inc. Social networking interactions with portions of digital videos
US10496252B2 (en) * 2016-01-06 2019-12-03 Robert Bosch Gmbh Interactive map informational lens
US20170206798A1 (en) * 2016-01-17 2017-07-20 Compedia Software and Hardware Development Ltd. Virtual Reality Training Method and System
US9871994B1 (en) * 2016-01-19 2018-01-16 Gopro, Inc. Apparatus and methods for providing content context using session metadata
US10078644B1 (en) * 2016-01-19 2018-09-18 Gopro, Inc. Apparatus and methods for manipulating multicamera content using content proxy
EP3196840B1 (en) * 2016-01-22 2022-12-14 Nokia Technologies Oy Displaying visual information of views captured at geographic locations
US9836652B2 (en) * 2016-02-02 2017-12-05 International Business Machines Corporation Showing danger areas associated with objects using augmented-reality display techniques
US10083537B1 (en) * 2016-02-04 2018-09-25 Gopro, Inc. Systems and methods for adding a moving visual element to a video
US10762795B2 (en) * 2016-02-08 2020-09-01 Skydio, Inc. Unmanned aerial vehicle privacy controls
US20170244959A1 (en) * 2016-02-19 2017-08-24 Adobe Systems Incorporated Selecting a View of a Multi-View Video
US9996149B1 (en) * 2016-02-22 2018-06-12 Immersacad Corporation Method for one-touch translational navigation of immersive, virtual reality environments
CN107134160A (zh) * 2016-02-29 2017-09-05 法拉第未来公司 紧急信号检测和响应
US10824320B2 (en) * 2016-03-07 2020-11-03 Facebook, Inc. Systems and methods for presenting content
AU2017203515A1 (en) * 2016-03-08 2017-09-28 Chill Gaming Pty Ltd Gaming method, system and machine comprising multiple games
US20170270362A1 (en) * 2016-03-18 2017-09-21 Daqri, Llc Responsive Augmented Content
US10088898B2 (en) * 2016-03-31 2018-10-02 Verizon Patent And Licensing Inc. Methods and systems for determining an effectiveness of content in an immersive virtual reality world
US10048751B2 (en) * 2016-03-31 2018-08-14 Verizon Patent And Licensing Inc. Methods and systems for gaze-based control of virtual reality media content
US10270825B2 (en) * 2016-03-31 2019-04-23 Verizon Patent And Licensing Inc. Prediction-based methods and systems for efficient distribution of virtual reality media content
US10395435B2 (en) * 2016-04-04 2019-08-27 Occipital, Inc. System for multimedia spatial annotation, visualization, and recommendation
US11087639B2 (en) * 2016-04-04 2021-08-10 The Raymond Corporation Systems and methods for vehicle simulation
CA3023488C (en) * 2016-04-14 2022-06-28 The Research Foundation For The State University Of New York System and method for generating a progressive representation associated with surjectively mapped virtual and physical reality image data
US10003847B2 (en) * 2016-04-22 2018-06-19 Google Llc Watch-time clustering for improving video searches, selection and provision
US10190791B2 (en) * 2016-04-27 2019-01-29 Crestron Electronics, Inc. Three-dimensional building management system visualization
US20170316806A1 (en) * 2016-05-02 2017-11-02 Facebook, Inc. Systems and methods for presenting content
KR20170126295A (ko) * 2016-05-09 2017-11-17 엘지전자 주식회사 헤드 마운티드 디스플레이 장치 및 그것의 제어방법
US10670421B2 (en) * 2016-05-11 2020-06-02 Ricoh Company, Ltd. Apparatus, system, and method of information sharing, and recording medium
JP6089133B1 (ja) * 2016-05-23 2017-03-01 三菱日立パワーシステムズ株式会社 三次元データ表示装置、三次元データ表示方法、およびプログラム
US10302446B2 (en) * 2016-06-12 2019-05-28 Apple Inc. Context driven navigation presentation
US11794108B2 (en) * 2016-06-13 2023-10-24 Sony Interactive Entertainment LLC Method and system for saving a snapshot of game play and used to begin later execution of the game play by any user as executed on a game cloud system
US10981061B2 (en) * 2016-06-13 2021-04-20 Sony Interactive Entertainment LLC Method and system for directing user attention to a location based game play companion application
US11045737B2 (en) * 2016-06-13 2021-06-29 Sony Interactive Entertainment LLC In-game location based game play companion application
US11278807B2 (en) * 2016-06-13 2022-03-22 Sony Interactive Entertainment LLC Game play companion application
US11216857B2 (en) * 2016-06-23 2022-01-04 Stubhub, Inc. Weather enhanced graphical preview for an online ticket marketplace
CN109982757A (zh) * 2016-06-30 2019-07-05 阿巴卡达巴广告和出版有限公司 数字多媒体平台
GB2552316A (en) * 2016-07-15 2018-01-24 Sony Corp Information processing apparatus, method and computer program product
WO2018014849A1 (zh) * 2016-07-20 2018-01-25 腾讯科技(深圳)有限公司 一种媒体信息展示方法、装置和计算机存储介质
US10179290B2 (en) * 2016-07-21 2019-01-15 Sony Interactive Entertainment America Llc Method and system for accessing previously stored game play via video recording as executed on a game cloud system
US20180025500A1 (en) * 2016-07-22 2018-01-25 Appropolis Inc. Method of tracking one or more mobile objects in a site and a system employing same
US10030979B2 (en) * 2016-07-29 2018-07-24 Matterport, Inc. Determining and/or generating a navigation path through a captured three-dimensional model rendered on a device
US10176640B2 (en) * 2016-08-02 2019-01-08 Qualtrics, Llc Conducting digital surveys utilizing virtual reality and augmented reality devices
US10506221B2 (en) * 2016-08-03 2019-12-10 Adobe Inc. Field of view rendering control of digital content
EP3285213A1 (en) * 2016-08-16 2018-02-21 Hexagon Technology Center GmbH Lod work package
US10255714B2 (en) * 2016-08-24 2019-04-09 Disney Enterprises, Inc. System and method of gaze predictive rendering of a focal area of an animation
US10516908B2 (en) * 2016-09-08 2019-12-24 Telefonaktiebolaget Lm Ericsson (Publ) Bitrate control in virtual reality (VR) environments using time-shifting and unicast delivery
US11395020B2 (en) * 2016-09-08 2022-07-19 Telefonaktiebolaget Lm Ericsson (Publ) Bitrate control in a virtual reality (VR) environment
US20180077440A1 (en) * 2016-09-09 2018-03-15 Cayke, Inc. System and method of creating, analyzing, and categorizing media
KR102545195B1 (ko) * 2016-09-12 2023-06-19 삼성전자주식회사 가상 현실 시스템에서 컨텐트 전송 및 재생 방법 및 장치
KR102632795B1 (ko) * 2016-09-21 2024-02-02 삼성전자주식회사 컨텐츠와 연관된 네비게이터 표시 방법 및 이를 구현한 전자 장치
US10643391B2 (en) * 2016-09-23 2020-05-05 Apple Inc. Immersive virtual display
US20180095938A1 (en) * 2016-09-30 2018-04-05 Sap Se Synchronized calendar and timeline adaptive user interface
US20180095618A1 (en) * 2016-10-04 2018-04-05 Facebook, Inc. Controls and Interfaces for User Interactions in Virtual Spaces
US20180095636A1 (en) * 2016-10-04 2018-04-05 Facebook, Inc. Controls and Interfaces for User Interactions in Virtual Spaces
US20180095635A1 (en) * 2016-10-04 2018-04-05 Facebook, Inc. Controls and Interfaces for User Interactions in Virtual Spaces
US20180096507A1 (en) * 2016-10-04 2018-04-05 Facebook, Inc. Controls and Interfaces for User Interactions in Virtual Spaces
US10606457B2 (en) * 2016-10-11 2020-03-31 Google Llc Shake event detection system
US10353388B2 (en) * 2016-10-17 2019-07-16 X Development Llc Drop-off location planning for delivery vehicle
US10754529B2 (en) * 2016-10-28 2020-08-25 Adobe Inc. Facilitating editing of virtual-reality content using a virtual-reality headset
WO2018085147A1 (en) * 2016-11-02 2018-05-11 Lr Acquisition, Llc Multimedia creation, production, and presentation based on sensor-driven events
US10204448B2 (en) * 2016-11-04 2019-02-12 Aquifi, Inc. System and method for portable active 3D scanning
KR20180051288A (ko) * 2016-11-08 2018-05-16 삼성전자주식회사 디스플레이 장치 및 그 제어 방법
US20180150204A1 (en) * 2016-11-30 2018-05-31 Google Inc. Switching of active objects in an augmented and/or virtual reality environment
US10652553B2 (en) * 2016-12-07 2020-05-12 Qualcomm Incorporated Systems and methods of signaling of regions of interest
US10769797B2 (en) * 2017-01-05 2020-09-08 Samsung Electronics Co., Ltd. Virtual reality experience sharing
US10594786B1 (en) * 2017-01-10 2020-03-17 Lucasfilm Entertainment Company Ltd. Multi-device interaction with an immersive environment
US11132840B2 (en) * 2017-01-16 2021-09-28 Samsung Electronics Co., Ltd Method and device for obtaining real time status and controlling of transmitting devices
US10235788B2 (en) * 2017-01-17 2019-03-19 Opentv, Inc. Overlay contrast control in augmented reality displays
US10152815B2 (en) * 2017-01-17 2018-12-11 Opentv, Inc. Overlay emphasis modification in augmented reality displays
EP3571845B1 (en) * 2017-01-20 2021-06-30 PCMS Holdings, Inc. Field-of-view prediction method based on contextual information for 360-degree vr video
GB201701877D0 (en) * 2017-02-05 2017-03-22 Hardie-Bick Anthony Richard Generating Locomotion Data
US10616624B2 (en) * 2017-03-01 2020-04-07 Rhinobird Inc. Multi-angle video synchronization and multi-angle video interface
KR101810671B1 (ko) * 2017-03-07 2018-01-25 링크플로우 주식회사 전방향 영상의 방향 정보를 생성하는 방법 및 이러한 방법을 수행하는 장치
US11133036B2 (en) * 2017-03-13 2021-09-28 Insoundz Ltd. System and method for associating audio feeds to corresponding video feeds
CN108632674B (zh) * 2017-03-23 2021-09-21 华为技术有限公司 一种全景视频的播放方法和客户端
US10216260B2 (en) * 2017-03-27 2019-02-26 Microsoft Technology Licensing, Llc Selective rendering of sparse peripheral displays based on element saliency
US10277943B2 (en) * 2017-03-27 2019-04-30 Microsoft Technology Licensing, Llc Selective rendering of sparse peripheral displays based on user movements
US20180284974A1 (en) * 2017-03-29 2018-10-04 Honeywell International Inc. Method for Recreating Time-Based Events Using a Building Monitoring System
US20200045359A1 (en) * 2017-04-04 2020-02-06 Sharp Kabushiki Kaisha Reproduction device, generation device, reproduction system, program, recording medium
US10321258B2 (en) * 2017-04-19 2019-06-11 Microsoft Technology Licensing, Llc Emulating spatial perception using virtual echolocation
GB201706412D0 (en) * 2017-04-22 2017-06-07 Hubschmann Michal Systems methods and computer readable media of stereoscopic display configured for searching and booking rooms
CA3002470A1 (en) * 2017-04-24 2018-10-24 Evertz Microsystems Ltd. Systems and methods for media production and editing
US20180314322A1 (en) * 2017-04-28 2018-11-01 Motive Force Technology Limited System and method for immersive cave application
US11241623B2 (en) * 2017-05-05 2022-02-08 Sony Interactive Entertainment LLC Instant streaming of a mobile user interface without application install
WO2018208924A1 (en) * 2017-05-09 2018-11-15 Google Llc Augmented and/or virtual reality footwear
US10475483B2 (en) * 2017-05-16 2019-11-12 Snap Inc. Method and system for recording and playing video using orientation of device
US11509944B2 (en) * 2017-05-18 2022-11-22 Nbcuniversal Media, Llc System and method for presenting contextual clips for distributed content
US10228760B1 (en) * 2017-05-23 2019-03-12 Visionary Vr, Inc. System and method for generating a virtual reality scene based on individual asynchronous motion capture recordings
US10348964B2 (en) * 2017-05-23 2019-07-09 International Business Machines Corporation Method and system for 360 degree video coverage visualization
US10769438B2 (en) * 2017-05-23 2020-09-08 Samsung Electronics Company, Ltd. Augmented reality
EP3413167A1 (en) * 2017-06-06 2018-12-12 Thomson Licensing Method and apparatus for inciting a viewer to rotate toward a reference direction when consuming an immersive content item
EP3412242A1 (de) * 2017-06-09 2018-12-12 Siemens Healthcare GmbH Ausgabe von positionsinformationen eines medizintechnischen instruments
EP3416092A1 (en) * 2017-06-16 2018-12-19 Thomson Licensing Method and devices to optimize marker management for pose estimation
US10534962B2 (en) * 2017-06-17 2020-01-14 Matterport, Inc. Automated classification based on photo-realistic image/model mappings
US10419716B1 (en) * 2017-06-28 2019-09-17 Vulcan Technologies Llc Ad-hoc dynamic capture of an immersive virtual reality experience
US10180735B1 (en) * 2017-06-29 2019-01-15 Trimble Inc. Navigation methods for three dimensional (3D) models in mixed reality (MR) environments
US10467804B2 (en) * 2017-06-29 2019-11-05 Open Space Labs, Inc. Automated spatial indexing of images based on floorplan features
WO2019005622A1 (en) * 2017-06-30 2019-01-03 Pcms Holdings, Inc. METHOD AND APPARATUS FOR GENERATING AND DISPLAYING 360-DEGREE VIDEO BASED ON FOLLOW-UP OF THE LOOK AND PHYSIOLOGICAL MEASUREMENTS
FR3068945B1 (fr) * 2017-07-11 2019-08-30 Institut Francais Des Sciences Et Technologies Des Transports, De L'amenagement Et Des Reseaux Vehicule routier et methode de reengagement de la conduite manuelle
US20190033989A1 (en) * 2017-07-31 2019-01-31 Google Inc. Virtual reality environment boundaries using depth sensors
US10803663B2 (en) * 2017-08-02 2020-10-13 Google Llc Depth sensor aided estimation of virtual reality environment boundaries
US10659679B1 (en) * 2017-08-16 2020-05-19 Disney Enterprises, Inc. Facial location determination
US10613703B2 (en) * 2017-08-18 2020-04-07 Adobe Inc. Collaborative interaction with virtual reality video
US10062414B1 (en) * 2017-08-22 2018-08-28 Futurewei Technologies, Inc. Determining a future field of view (FOV) for a particular user viewing a 360 degree video stream in a network
US10746560B2 (en) * 2017-09-05 2020-08-18 Byton Limited Interactive mapping
US11145125B1 (en) * 2017-09-13 2021-10-12 Lucasfilm Entertainment Company Ltd. Communication protocol for streaming mixed-reality environments between multiple devices
US10447394B2 (en) * 2017-09-15 2019-10-15 Qualcomm Incorporated Connection with remote internet of things (IoT) device based on field of view of camera
US10540054B2 (en) * 2017-09-20 2020-01-21 Matterport, Inc. Navigation point selection for navigating through virtual environments
EP3461132A1 (en) * 2017-09-26 2019-03-27 Thomson Licensing Method and terminal for tile selection amongst a set of tiles
US11190753B1 (en) * 2017-09-28 2021-11-30 Apple Inc. Head-mountable device with object movement detection
EP3688562A1 (en) * 2017-09-29 2020-08-05 Apple Inc. Physical boundary guardian
WO2019070608A1 (en) * 2017-10-02 2019-04-11 Howl Holdings Llc RETROSPECTIVE CAPTURE TRIGGER
US11025919B2 (en) * 2017-10-03 2021-06-01 Koninklijke Kpn N.V. Client-based adaptive streaming of nonlinear media
CN112272817B (zh) * 2017-10-12 2024-05-31 交互数字Ce专利控股有限公司 用于在沉浸式现实中提供音频内容的方法和装置
TWI642903B (zh) * 2017-10-13 2018-12-01 緯創資通股份有限公司 用於頭戴式顯示裝置的定位方法、***以及定位系統
JP7140487B2 (ja) * 2017-10-25 2022-09-21 キヤノン株式会社 情報処理装置、表示制御方法、及び、プログラム
US20190129602A1 (en) * 2017-10-27 2019-05-02 Greg Siwak Systems and methods for imaging grounding
FR3073046B1 (fr) * 2017-10-27 2019-11-15 Pfeiffer Vacuum Module de detection de fuites et procede de controle de l'etancheite d'un objet a tester par gaz traceur
RU2670429C1 (ru) * 2017-11-24 2018-10-23 ООО "Ай Ти Ви групп" Системы и способы отслеживания движущихся объектов на видеоизображении
JP2019101743A (ja) * 2017-12-01 2019-06-24 ソニー株式会社 情報処理装置、情報処理方法及びプログラム
US10916059B2 (en) * 2017-12-06 2021-02-09 Universal City Studios Llc Interactive video game system having an augmented virtual representation
US10712810B2 (en) * 2017-12-08 2020-07-14 Telefonaktiebolaget Lm Ericsson (Publ) System and method for interactive 360 video playback based on user location
US10510137B1 (en) * 2017-12-20 2019-12-17 Lockheed Martin Corporation Head mounted display (HMD) apparatus with a synthetic targeting system and method of use
US10275689B1 (en) * 2017-12-21 2019-04-30 Luminar Technologies, Inc. Object identification and labeling tool for training autonomous vehicle controllers
US10390063B2 (en) * 2017-12-22 2019-08-20 Comcast Cable Communications, Llc Predictive content delivery for video streaming services
US10791373B2 (en) * 2017-12-29 2020-09-29 Intel Corporation Generating 2D video from 360 video
US11079753B1 (en) * 2018-01-07 2021-08-03 Matthew Roy Self-driving vehicle with remote user supervision and temporary override
JP2019125303A (ja) * 2018-01-19 2019-07-25 キヤノン株式会社 情報処理装置、情報処理方法、およびプログラム
JP7073128B2 (ja) * 2018-02-08 2022-05-23 キヤノン株式会社 通信装置、通信方法、及びプログラム
US12046262B2 (en) * 2018-02-21 2024-07-23 Comcast Cable Communications, Llc Content playback control
KR20190100714A (ko) * 2018-02-21 2019-08-29 삼성전자주식회사 정보 표시 방법 및 이를 위한 전자 장치
US10902676B2 (en) * 2018-03-13 2021-01-26 Canon Kabushiki Kaisha System and method of controlling a virtual camera
JP7132730B2 (ja) * 2018-03-14 2022-09-07 キヤノン株式会社 情報処理装置および情報処理方法
US20190289341A1 (en) * 2018-03-19 2019-09-19 Eyesee, Lda Media object insertion systems for panoramic media
US11227439B2 (en) * 2018-03-29 2022-01-18 Eon Reality, Inc. Systems and methods for multi-user virtual reality remote training
US10504288B2 (en) * 2018-04-17 2019-12-10 Patrick Piemonte & Ryan Staake Systems and methods for shared creation of augmented reality
US10496366B2 (en) * 2018-04-18 2019-12-03 Comcast Cable Communications, Llc Method to determine intended direction of a vocal command and target for vocal interaction
JP2020005038A (ja) * 2018-06-25 2020-01-09 キヤノン株式会社 送信装置、送信方法、受信装置、受信方法、及び、プログラム
US20180345129A1 (en) * 2018-07-27 2018-12-06 Yogesh Rathod Display virtual objects within predefined geofence or receiving of unique code from closest beacon
US11113884B2 (en) * 2018-07-30 2021-09-07 Disney Enterprises, Inc. Techniques for immersive virtual reality experiences
US11587292B2 (en) * 2018-07-30 2023-02-21 Disney Enterprises, Inc. Triggered virtual reality and augmented reality events in video streams
JP7301507B2 (ja) * 2018-08-08 2023-07-03 キヤノン株式会社 情報処理装置、情報処理方法、及びプログラム
US10757389B2 (en) * 2018-10-01 2020-08-25 Telefonaktiebolaget Lm Ericsson (Publ) Client optimization for providing quality control in 360° immersive video during pause
WO2020075593A1 (ja) * 2018-10-09 2020-04-16 株式会社ソニー・インタラクティブエンタテインメント 情報処理システム、情報処理装置およびコンテンツファイルの生成方法
US11087549B2 (en) * 2018-10-15 2021-08-10 University Of Maryland, College Park Methods and apparatuses for dynamic navigable 360 degree environments
US20200189459A1 (en) * 2018-12-13 2020-06-18 GM Global Technology Operations LLC Method and system for assessing errant threat detection
US10818077B2 (en) * 2018-12-14 2020-10-27 Canon Kabushiki Kaisha Method, system and apparatus for controlling a virtual camera
US20200201512A1 (en) * 2018-12-20 2020-06-25 Microsoft Technology Licensing, Llc Interactive editing system
US10602300B1 (en) * 2019-01-27 2020-03-24 Philip Scott Lyren Switching binaural sound from head movements
US10602302B1 (en) * 2019-02-06 2020-03-24 Philip Scott Lyren Displaying a location of binaural sound outside a field of view
JP7063316B2 (ja) * 2019-02-14 2022-05-09 株式会社デンソー 表示制御装置及び表示制御プログラム
US10997776B2 (en) * 2019-02-23 2021-05-04 Microsoft Technology Licensing, Llc Connecting spatial anchors for augmented reality
US20200285784A1 (en) * 2019-02-27 2020-09-10 Simulation Engineering, LLC Systems and methods for generating a simulated environment
US10885710B2 (en) * 2019-03-14 2021-01-05 Microsoft Technology Licensing, Llc Reality-guided roaming in virtual reality
US10918945B2 (en) * 2019-03-15 2021-02-16 Sony Interactive Entertainment Inc. Methods and systems for spectating characters in follow-mode for virtual reality views
WO2020209120A1 (ja) * 2019-04-11 2020-10-15 ソニー株式会社 再生装置
US11361513B2 (en) * 2019-04-23 2022-06-14 Valve Corporation Head-mounted display with pass-through imaging
US20200349751A1 (en) * 2019-04-30 2020-11-05 Number 9, LLC Presentation interface and immersion platform
US11010984B2 (en) * 2019-06-05 2021-05-18 Sagan Works, Inc. Three-dimensional conversion of a digital file spatially positioned in a three-dimensional virtual environment
US10944996B2 (en) * 2019-08-19 2021-03-09 Intel Corporation Visual quality optimized video compression
US11481026B2 (en) * 2019-08-22 2022-10-25 Samsung Electronics Co., Ltd. Immersive device and method for streaming of immersive media
US11180159B1 (en) * 2019-08-30 2021-11-23 United Services Automobile Association (Usaa) Intelligent vehicle guidance for improved driving safety
US11315326B2 (en) * 2019-10-15 2022-04-26 At&T Intellectual Property I, L.P. Extended reality anchor caching based on viewport prediction
US11204678B1 (en) * 2019-12-11 2021-12-21 Amazon Technologies, Inc. User interfaces for object exploration in virtual reality environments
US11468605B2 (en) * 2019-12-12 2022-10-11 Sony Interactive Entertainment Inc. VR real player capture for in-game interaction view
US10974147B1 (en) * 2019-12-19 2021-04-13 Sony Interactive Entertainment Inc. Spectator switch board customized to user viewport selection actions
US11645579B2 (en) * 2019-12-20 2023-05-09 Disney Enterprises, Inc. Automated machine learning tagging and optimization of review procedures
US11562422B2 (en) * 2020-02-17 2023-01-24 Wipro Limited System and method of shopping using a virtual reality device and an avatar
US11660528B2 (en) * 2020-03-12 2023-05-30 Reavire, Inc. Populating virtual objects in physical environments
US11493764B2 (en) * 2020-06-04 2022-11-08 Htc Corporation Method for dynamically displaying real-world scene, electronic device, and computer readable medium
US20220058825A1 (en) * 2020-08-18 2022-02-24 Here Global B.V. Attention guidance for correspondence labeling in street view image pairs
US11361490B2 (en) * 2020-08-18 2022-06-14 Here Global B.V. Attention guidance for ground control labeling in street view imagery
US11544904B1 (en) * 2020-10-16 2023-01-03 Splunk Inc. Mesh updates in an extended reality environment
US11551421B1 (en) * 2020-10-16 2023-01-10 Splunk Inc. Mesh updates via mesh frustum cutting
US11538214B2 (en) * 2020-11-09 2022-12-27 Meta Platforms Technologies, Llc Systems and methods for displaying stereoscopic rendered image data captured from multiple perspectives
US11671573B2 (en) * 2020-12-14 2023-06-06 International Business Machines Corporation Using reinforcement learning and personalized recommendations to generate a video stream having a predicted, personalized, and enhance-quality field-of-view
US11590421B2 (en) * 2021-03-29 2023-02-28 Niantic, Inc. Travel of virtual characters
US20220319014A1 (en) * 2021-04-05 2022-10-06 Facebook Technologies, Llc Systems and methods for dynamic image processing and segmentation
US11861315B2 (en) * 2021-04-21 2024-01-02 Meta Platforms, Inc. Continuous learning for natural-language understanding models for assistant systems
US11978154B2 (en) * 2021-04-23 2024-05-07 Lucasfilm Entertainment Company Ltd. System and techniques for lighting adjustment for an immersive content production system
US11511206B2 (en) * 2022-03-17 2022-11-29 Ellie DAO Immersion platform

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102369497A (zh) * 2009-03-31 2012-03-07 派尔高公司 用于在视频显示器中创建目标区域的方法和设备
CN102244807A (zh) * 2010-06-02 2011-11-16 微软公司 自适应视频变焦
CN102611872A (zh) * 2011-01-19 2012-07-25 株式会社理光 基于感兴趣区域动态检测的场景影像转换***和方法
CN104685893A (zh) * 2012-06-29 2015-06-03 弗兰霍菲尔运输应用研究公司 视频数据流概念技术
CN104185078A (zh) * 2013-05-20 2014-12-03 华为技术有限公司 视频监控处理方法、装置及***

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114786051A (zh) * 2022-03-31 2022-07-22 北京百度网讯科技有限公司 一种视频渲染方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
JP2018530219A (ja) 2018-10-11
KR20180048656A (ko) 2018-05-10
EP3345184A1 (en) 2018-07-11
JP6879479B2 (ja) 2021-06-02
US20180182168A1 (en) 2018-06-28
CN107924690B (zh) 2021-06-25
US11699266B2 (en) 2023-07-11
WO2017036953A1 (en) 2017-03-09
KR102551239B1 (ko) 2023-07-05
TW201710646A (zh) 2017-03-16
US20230298275A1 (en) 2023-09-21

Similar Documents

Publication Publication Date Title
CN107924690A (zh) 用于促进扩展场景中的导航的方法、装置和***
US11538066B2 (en) Method for serving interactive content to a user
CN104904195A (zh) 增强现实的设备和方法
CN114385052B (zh) 一种Tab栏的动态展示方法及三维显示设备
US20140253591A1 (en) Information processing system, information processing apparatus, information processing method, and computer-readable recording medium recording information processing program
US11727442B2 (en) Method for serving interactive content to a user
CN108744515B (zh) 游戏中预览地图的显示控制方法、装置、设备及存储介质
Wang et al. Transitioning360: Content-aware nfov virtual camera paths for 360 video playback
US12033270B2 (en) Systems and methods for generating stabilized images of a real environment in artificial reality
US9349204B1 (en) Systems and methods for generating videos using animation and motion capture scene information
CN108140401B (zh) 访问视频片段
CN113709389A (zh) 一种视频渲染方法、装置、电子设备及存储介质
Köppel et al. Context-responsive labeling in augmented reality
US8957855B2 (en) Method for displaying a stereoscopic cursor among stereoscopic objects
CN110708591B (zh) 一种图像处理方法、装置及电子设备
CN113282167B (zh) 头戴式显示设备的交互方法、装置及头戴式显示设备
US8732620B2 (en) Method and system for a more realistic interaction experience using a stereoscopic cursor
US20230075650A1 (en) Representation of Media Data
US20240143346A1 (en) Methods, systems, and media for generating modified user engagement signals based on obstructing layers in a user interface
US12045931B2 (en) Method and electronic device for selective magnification in three dimensional rendering systems
CN118227000A (zh) 一种基于ar技术的产品展示方法、设备及介质
CN118035580A (zh) 一种页面中三维控件的显示方法及装置
CN115445192A (zh) 虚拟对象显示方法、装置、计算机设备和存储介质
CN113780141A (zh) 一种对弈模型的构建方法和装置
CN114666645A (zh) 视频帧图像的标注方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20190527

Address after: France

Applicant after: Interactive Digital CE Patent Holding Company

Address before: I Si Eli Murli Nor, France

Applicant before: Thomson Licensing SA

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant