WO2019129125A1 - 智能眼镜与智能设备交互的方法、***及存储介质 - Google Patents

智能眼镜与智能设备交互的方法、***及存储介质 Download PDF

Info

Publication number
WO2019129125A1
WO2019129125A1 PCT/CN2018/124196 CN2018124196W WO2019129125A1 WO 2019129125 A1 WO2019129125 A1 WO 2019129125A1 CN 2018124196 W CN2018124196 W CN 2018124196W WO 2019129125 A1 WO2019129125 A1 WO 2019129125A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart
smart device
smart glasses
glasses
transmission
Prior art date
Application number
PCT/CN2018/124196
Other languages
English (en)
French (fr)
Inventor
梁海涛
Original Assignee
中兴通讯股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中兴通讯股份有限公司 filed Critical 中兴通讯股份有限公司
Priority to US16/768,695 priority Critical patent/US11304247B2/en
Publication of WO2019129125A1 publication Critical patent/WO2019129125A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/10—Architectures or entities
    • H04L65/1059—End-user terminal functionalities specially adapted for real-time communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1069—Session establishment or de-establishment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1083—In-session procedures
    • H04L65/1094—Inter-user-equipment sessions transfer or sharing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/14—Direct-mode setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/06—Authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/30—Connection release
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W84/00—Network topologies
    • H04W84/02—Hierarchically pre-organised networks, e.g. paging networks, cellular networks, WLAN [Wireless Local Area Network] or WLL [Wireless Local Loop]
    • H04W84/10—Small scale networks; Flat hierarchical networks
    • H04W84/12—WLAN [Wireless Local Area Networks]

Definitions

  • the present disclosure relates to, but is not limited to, the field of communication technology.
  • Smart glasses A user-wearable smart terminal with an independent operating system that allows users to install software, games, and other applications provided by software service providers, and can access wireless networks through a mobile communication network.
  • smart glasses are affected by power consumption, processing power and storage capacity, cannot carry a large amount of data, and cannot connect to a base station or perform GPS positioning for a long time.
  • the current interaction between smart glasses and smart devices is mainly Bluetooth, but the data transmission capability using Bluetooth for interaction is weak and the user experience is poor, and there are obvious deficiencies, resulting in narrow application scenarios of smart glasses.
  • a method for interacting smart glasses with a smart device comprising: establishing a WiFi direct communication connection between the smart glasses and the smart device; and conducting communication negotiation between the smart glasses and the smart device And data transmission between smart glasses and smart devices based on the results of WiFi direct connection and communication negotiation.
  • an embodiment of the present disclosure further provides an interactive system, including smart glasses and a smart device, wherein after establishing a WiFi direct communication connection between the smart glasses and the smart device, communication negotiation is performed between the smart glasses and the smart device. And data transmission between the smart glasses and the smart device based on the results of the WiFi direct connection and the communication negotiation.
  • embodiments of the present disclosure also provide an interactive system including smart glasses, a smart device, a memory, and a processor, where a computer program is stored on the memory, and when the processor runs the computer program, the processor performs the A method of interacting with a smart device of the present invention.
  • the present disclosure also proposes a computer readable storage medium having stored thereon a computer program that, when executed by a processor, performs a method of interacting with a smart device in accordance with the present disclosure.
  • FIG. 1 is a flow chart showing a method of interacting smart glasses with a smart device according to an embodiment of the present disclosure
  • FIG. 2 is a schematic flow chart of a method for interacting smart glasses with a smart device according to another embodiment of the present disclosure
  • FIG. 3 is a schematic flow chart of a method for data transmission between smart glasses and a smart device according to an embodiment of the present disclosure
  • FIG. 4 is a structural block diagram of a method of interacting smart glasses with a smart device in accordance with an embodiment of the present disclosure
  • FIG. 5 is a flowchart of interaction between smart glasses and a smart device according to an embodiment of the present disclosure
  • FIG. 6 is a schematic structural diagram of a terminal according to an embodiment of the present disclosure.
  • Bluetooth connection not only has weak data transmission capability, but also the interaction between smart glasses and smart devices is one-way transmission and control, and cannot be between smart glasses and smart devices. Free switching control and transmission direction, resulting in narrow application scenarios of smart glasses and poor user experience.
  • the present disclosure provides a method, a system and a storage medium for interacting between smart glasses and smart devices, which can realize high-speed, two-way and convenient connection between smart glasses and smart devices, and improve data transmission speed and data bidirectional between smart glasses and smart devices. Transmission control.
  • a method for interacting a smart glasses with a smart device includes: establishing a communication connection between the smart glasses and the smart device via WiFi; conducting communication negotiation between the smart glasses and the smart device, wherein the content of the communication negotiation
  • the communication format includes at least one of a transmission format, an audio and video encoding format, and a transmission mode. After the communication negotiation is completed, data transmission is performed between the smart glasses and the smart device according to the WiFi direct connection and the result of the communication negotiation.
  • FIG. 1 is a flow diagram of a method of interacting smart glasses with a smart device in accordance with an embodiment of the present disclosure.
  • the party in which the smart glasses interact with the smart device includes the following steps S10 to S30.
  • step S10 a WiFi direct communication connection is established between the smart glasses and the smart device.
  • step S20 communication negotiation is performed between the smart glasses and the smart device, wherein the content of the communication negotiation includes at least one of a transmission format, an audio and video encoding format, and a transmission mode.
  • the smart device may be a terminal device having a wireless communication connection function such as a mobile phone, an ipad, or a computer.
  • WiFi direct communication connection between smart glasses and smart devices can realize a pair of continuous connections without router support, thus eliminating the constraints of routers, enabling wireless devices to be interconnected in a point-to-point manner, and WiFi direct connection standard can support all
  • the WiFi device supports 2.4GHz or 5GHz frequency, which improves the data transmission speed and transmission distance compared to the existing interaction mode.
  • WPA2 standard encryption can be used to improve the security of data transmission.
  • this communication method follows the Real Time Streaming Protocol (RTSP) that supports real-time data.
  • RTSP itself does not transmit continuous media streams, but acts as a controller for the multimedia server.
  • the content of the communication negotiation may include a transmission format, an audio and video encoding format, a playback URL information, and an RTP (Real-time Transport Protocol) using a Transmission Control Protocol (TCP) mode. Transfer information and other information. Transmission control and negotiation ensure the reliability of control signaling through the RTSP channel.
  • RTSP Real Time Streaming Protocol
  • TCP Transmission Control Protocol
  • step S30 data transmission is performed between the smart glasses and the smart device based on the results of the WiFi direct connection and the communication negotiation.
  • data can be transmitted between the smart glasses and the smart device, that is, the interaction between the smart glasses and the smart device can be realized.
  • Smart glasses users do not need to set up a smart card to have a memory card to play files on the smart device, such as audio and video files, and also conveniently use the smart device's positioning system and map application, running smart devices and interactive games between smart glasses.
  • images taken by smart glasses can be shared to smart devices in real time. Thus, the user experience can be greatly improved by the interactive manner of the present disclosure.
  • a communication connection is first established between the smart glasses and the smart device through WiFi; then communication negotiation is performed between the smart glasses and the smart device; and after the communication negotiation is completed, between the smart glasses and the smart device
  • the result of communication negotiation is data transmission, thereby improving the speed of data transmission between the smart glasses and the smart device, realizing high-speed, two-way and convenient connection between the smart glasses and the smart device, thereby improving the user experience.
  • FIG. 2 is a schematic flow chart of a method for interacting smart glasses with a smart device according to another embodiment of the present disclosure.
  • step S10 in the above embodiment may include steps S100 to S103.
  • step S100 the smart glasses and the smart device system are activated, and the system software and hardware are initialized.
  • the wireless transmission module, the audio module, and the video module of the smart glasses and the smart device are respectively initialized.
  • step S101 the smart device sends a search signal on the associated communication channel, and monitors whether there is smart glasses in the associated communication channel, and if so, displays the smart glasses list to the user.
  • the smart device After the smart glasses and the smart device direct connection service are started, when the smart device searches for the smart glasses, it sends a signal to the channel, and registers the listener to monitor the response result. If the smart device monitors the presence of smart glasses in the channel, the smart glasses are The list is displayed to the user.
  • step S102 after receiving the user's selection instruction, the smart device selects the smart glasses to be connected, initiates a connection, and performs authentication.
  • the authentication can be performed by an authentication method preset by the user. For example, a verification code such as a verification number and a graphic set in advance is input on the input interface of the smart device.
  • step S103 after the authentication is successful, a WiFi direct connection is established between the smart glasses and the smart device.
  • FIG. 3 is a schematic flow chart of a method for data transmission between smart glasses and a smart device according to an embodiment of the present disclosure.
  • step S30 in the above embodiment may include steps S301 to S302.
  • step S301 the sender compresses and multiplexes the data to be transmitted, adds an RTP header, and then transmits the data to the receiver through UDP (User Datagram Protocol)/IP.
  • UDP User Datagram Protocol
  • step S302 the receiver decapsulates, demultiplexes, and decompresses the received data to present and save the data.
  • the sender may be a smart glasses, and the recipient may be a smart device; or the sender may be a smart device, and the recipient may be a smart glasses.
  • the sender first compresses the data to be sent, packs it into the elementary stream (PES) format, and then combines and multiplexes the data in the MPEG2-TS manner, adds the RTP header, and finally transmits to the receiving through UDP/IP. square.
  • PES elementary stream
  • the receiver decapsulates, demultiplexes, and decompresses the received data to present and save the data.
  • the content of the communication negotiation further includes negotiation of the transmission control right, and the smart glasses and the smart device may perform switching control on the data transmission based on the negotiated transmission control right, so that the data transmission direction and the control right switching may be implemented.
  • the step of controlling the data transmission by the smart glasses and the smart device based on the negotiated transmission control right comprises: sending a control right request message to the receiving party; and receiving the control right application message after receiving the sending party Release the current control and confirm the termination of the current data transfer to complete the data transfer direction and control switching.
  • the smart device compresses, multiplexes, and adds the RTP header to the data to be sent, and then sends the data to the smart glasses through UDP/IP.
  • the smart glasses decapsulate, demultiplex, and decompress the received data. To present and save the data, then, if the smart glasses need to send data to the smart device, the smart glasses send control application information to the smart device, and the smart device releases the control right, and confirms to terminate the current data transfer to complete the data transmission direction and Control switching.
  • the smart glasses compress and multiplex the data to be sent, and add the RTP header, and then send it to the smart device through UDP/IP, and the smart device decapsulates, demultiplexes, and decompresses the received data.
  • the smart device sends control application information to the smart glasses, and the smart glasses release control, and at the same time confirm to terminate the current data transfer to complete the data transmission direction. And control switching.
  • the reliability of the signaling is ensured by adding the RTP header to the transmission control signaling and transmitting it through TCP/IP. Both parties can negotiate control over the transmission and achieve two-way transmission and control.
  • information stored on the smart device such as captured images
  • data on smart glasses can be transmitted between the smart device and the smart glasses at high speed and two-way, smart devices and smart glasses.
  • the interaction is also more convenient, which enhances the user experience.
  • the sender may send an instruction to the recipient to disconnect the communication, and the receiver may disconnect the communication according to the instruction.
  • the sender can be either a smart glasses or a smart device; correspondingly, the receiver can be either a smart device or a smart glasses.
  • the architecture of the method for interacting the smart glasses with the smart device includes a physical link layer, a network layer, a transport layer, a multiplexing layer, and an application layer.
  • WiFi is directly connected at the physical link layer, which is free from the constraints of routers.
  • Wireless devices are interconnected in a point-to-point manner, and the transmission speed and transmission distance are greatly improved compared with Bluetooth.
  • the IP protocol is used at the network layer, and the TCP ⁇ UDP protocol is adopted at the transport layer, where TCP is used to transmit control signaling to ensure control reliability.
  • RTSP and RTP are used to ensure reliable and real-time communication.
  • RTSP provides an extensible framework to control transmission, enabling real-time data to efficiently transmit multimedia data over IP networks.
  • the top layer is the user application, responsible for multimedia presentation and control.
  • the following describes the interaction process between the smart glasses and the smart devices by using smart devices to share data with the smart glasses, as shown in FIG. 5 .
  • the smart glasses and device system are powered on, and the wireless transmission module and the audio and video module (the above modules can be set according to the function requirements) are initialized separately.
  • the WiFi direct connection service of the two devices is started.
  • the smart device searches for the smart glasses, it sends a signal to the channel and listens to the response result through the listener.
  • the WiFi direct connection method can realize a pair of continuous connection without router support, and the WiFi direct connection standard will support all WiFi devices, support 2.4GHz or 5GHz frequency, and realize the transmission speed and coverage of traditional WiFi (up to 802.11n). Range and can be encrypted using WPA2 standard.
  • RTSP This communication method follows RTSP that supports real-time data.
  • RTSP itself does not transmit continuous media streams, but acts as a controller for the multimedia server.
  • the content of the communication negotiation may include information such as a transmission format, an audio and video encoding format, a playback URL information, and an RTP transmission using a TCP mode.
  • Transmission control and negotiation ensure the reliability of control signaling through the RTSP channel.
  • the two-way control adds a control right application procedure on the basis of the RTSP. After the transmitting terminal receives the control right application message of the receiving terminal, the sending terminal releases the control right and confirms the termination of the current data transmission to complete the data transmission direction and control. Switch.
  • the entire data exchange process includes: first compressing the data to be sent for packaging into a basic stream (PES) format, and then multiplexing and multiplexing the multimedia data in an MPEG2-TS manner, and adding an RTP header. Department, finally transmitted by UDP/IP.
  • PES basic stream
  • the receiving end decapsulates, demultiplexes, and decompresses the received data to present, for example, multimedia data.
  • both the smart device and the smart glasses can initiate a disconnect.
  • the present invention proposes an implementation scheme based on the WiFi direct connection technology, so that the interactive transmission speed can reach more than 1 M/s, and the bandwidth no longer becomes a bottleneck.
  • the embodiments of the present disclosure adopt a protocol group that is continuously modified and optimized through practice, which can ensure the real-time interaction and ensure the security and reliability of the interaction; the multimedia data mirror transmission can be performed, and the data can be saved in real time.
  • control rights can be exchanged in one connection, and bidirectional transmission and control between the smart device and the smart glasses are realized.
  • the smart device can share audio and video and application presentation to the smart glasses, and the smart glasses can also transmit information such as captured images to the smart device.
  • An embodiment of the present disclosure further provides an interactive system, including smart glasses and a smart device, wherein after establishing a WiFi direct communication connection between the smart glasses and the smart device, communication negotiation between the smart glasses and the smart device is performed, and based on As a result of the WiFi direct connection and the communication negotiation, data transmission is performed between the smart glasses and the smart device.
  • Embodiments of the present disclosure also propose an interactive system including smart glasses, a smart device, a memory, and a processor.
  • a computer program is stored on the memory, and when the computer program is executed by the processor, the processor performs the steps of: establishing a communication connection between the smart glasses and the smart device via WiFi; and conducting communication negotiation between the smart glasses and the smart device And data transmission between the smart glasses and the smart device according to the communication negotiation.
  • the smart device may be a terminal device having a wireless communication connection function such as a mobile phone, an ipad, or a computer.
  • the terminal in which the smart glasses interact with the smart device may include a processor 1001 (eg, a CPU), a network interface 1004, a user interface 1003, a memory 1005, and a communication bus 1002.
  • Communication bus 1002 provides connection communication between these components.
  • the user interface 1003 can include a display screen and an input unit such as a keyboard.
  • the user interface 1003 may also include a standard wired interface, a wireless interface.
  • the network interface 1004 can optionally include a standard wired network interface, a wireless network interface (such as a WI-FI interface).
  • the memory 1005 may be a high speed RAM memory or a nonvolatile memory such as a magnetic disk memory.
  • the memory 100 can be a storage device that is independent of the processor 1001.
  • terminal structure shown in FIG. 6 does not constitute a limitation to the terminal, and may include more or less components than those illustrated, or a combination of certain components, or different component arrangements.
  • the memory 1005 as a computer storage medium may include an operating device, a network communication module, a user interface module, and an application for the smart glasses to interact with the smart device.
  • the network interface 1004 is used to connect to the network server and perform data communication with the network server;
  • the user interface 1003 is used to connect to the client (user end) and perform data communication with the client;
  • the processor 1001 A method for calling a computer program stored in the memory 1005 for smart glasses to interact with the smart device, and performing a method of interacting the smart glasses with the smart device according to various embodiments of the present disclosure.
  • embodiments of the present disclosure also provide a computer readable storage medium having stored thereon a computer program that, when executed by a processor, executes smart glasses and smart devices according to various embodiments of the present disclosure The method of interaction.
  • Such software may be distributed on a computer readable medium, which may include computer storage media (or non-transitory media) and communication media (or transitory media).
  • computer storage medium includes volatile and nonvolatile, implemented in any method or technology for storing information, such as computer readable instructions, data structures, program modules or other data. Sex, removable and non-removable media.
  • Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridge, magnetic tape, magnetic disk storage or other magnetic storage device, or may Any other medium used to store the desired information and that can be accessed by the computer.
  • communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as a carrier wave or other transport mechanism, and can include any information delivery media. .

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Mobile Radio Communication Systems (AREA)
  • Telephone Function (AREA)

Abstract

一种智能眼镜与智能设备交互的方法、***及存储介质，方法包括：在智能眼镜与智能设备之间建立WiFi直连通信连接(S10)；在智能眼镜与智能设备之间进行通信协商(S20)；以及基于WiFi直连通信连接以及通信协商的结果，在智能眼镜与智能设备之间进行数据传输(S30)。

Description

智能眼镜与智能设备交互的方法、***及存储介质 技术领域
本公开涉及(但不限于)通讯技术领域。
背景技术
智能眼镜一种用户可佩带的智能终端，具有独立的操作***，可以由用户安装软件、游戏等由软件服务商提供的应用程序，并且可以通过移动通讯网络来实现无线网络接入。
目前，智能眼镜受功耗、处理能力和存储能力的影响，不能携带大量数据，不能长时间连接基站或进行GPS定位。此外，目前的智能眼镜与智能设备之间的交互方式以蓝牙为主，但是采用蓝牙进行交互的数据传输能力弱、用户体验差，存在明显的不足，造成智能眼镜的应用场景狭窄。
发明内容
根据本公开的实施例，提供一种智能眼镜与智能设备交互的方法，所述方法包括：在智能眼镜与智能设备之间建立WiFi直连通信连接；在智能眼镜与智能设备之间进行通信协商；以及基于WiFi直连通信连接以及通信协商的结果，在智能眼镜与智能设备之间进行数据传输。
此外，本公开的实施例还提出一种交互***，包括智能眼镜与智能设备，其中，在智能眼镜与智能设备之间建立WiFi直连通信连接后，在智能眼镜与智能设备之间进行通信协商，并且基于WiFi直连通信连接以及通信协商的结果，在智能眼镜与智能设备之间进行数据传输。
此外，本公开的实施例还提出一种交互***，包括智能眼镜、智能设备、存储器和处理器，在存储器上存储有计算机程序，当处理器运行所述计算机程序时，所述处理器执行根据本公开的智能眼镜与智能设备交互的方法。
本公开还提出一种计算机可读存储介质，其上存储有计算机程序，当处理器执行所述计算机程序时，所述处理器执行根据本公开的智能眼镜与智能设备交互的方法。
附图说明
图1是根据本公开实施例的智能眼镜与智能设备交互的方法的流程示意图；
图2是根据本公开另一实施例的智能眼镜与智能设备交互的方法的流程示意图；
图3是根据本公开实施例的在智能眼镜与智能设备之间进行数据传输的方法流程示意图；
图4是根据本公开实施例的智能眼镜与智能设备交互的方法的架构框图；
图5是根据本公开实施例的智能眼镜与智能设备的交互流程图；以及
图6是根据本公开实施例的的终端的结构示意图。
具体实施方式
应当理解，此处所描述的具体实施例仅仅用以解释本公开，并不用于限定本公开。
目前，智能眼镜与智能设备之间通过蓝牙连接进行交互，采用蓝牙连接不仅传输数据能力弱，而且智能眼镜与智能设备之间的交互是单向传输和控制，不能在智能眼镜与智能设备之间自由切换控制与传输方向，造成智能眼镜的应用场景狭窄，用户体验不佳。
本公开提出一种智能眼镜与智能设备交互的方法、***及存储介质，可以实现智能眼镜与智能设备之间高速、双向、便捷的连接，提高智能眼镜与智能设备之间数据传输速度及数据双向传输控制。
根据本公开实施例的智能眼镜与智能设备交互的方法包括：在智能眼镜与智能设备之间通过WiFi建立通信连接；在智能眼镜与智能设备之间进行通信协商，其中，所述通信协商的内容包括传输格式、 音视频编码格式、以及传输模式等信息中的至少之一；在通信协商完成后，在智能眼镜与智能设备之间根据WiFi直连通信连接以及通信协商的结果进行数据传输。
图1是根据本公开实施例的智能眼镜与智能设备交互的方法的流程示意图。
如图1所示，根据本公开实施例的智能眼镜与智能设备交互的方包括以下步骤S10至S30。
在步骤S10，在智能眼镜与智能设备之间建立WiFi直连通信连接。
在步骤S20，在智能眼镜与智能设备之间进行通信协商，其中，通信协商的内容包括传输格式、音视频编码格式、以及传输模式等信息中的至少之一。
智能设备可以是手机、ipad、电脑等具有无线通信连接功能的终端设备。
在智能眼镜与智能设备之间采用WiFi直连通信连接，可以无需路由器支持而实现一对一直连，从而脱离了路由器束缚，使得无线设备可以以点对点方式互连，并且WiFi直连标准可以支持所有的WiFi设备，支持2.4GHz或5GHz频率，相对于现有的交互方式，提高了数据的传输速度和传输距离。另外，可以采用WPA2标准加密，以提高数据传输的安全性。
另外，这种通信方式遵循支持实时数据的实时流传输协议(RTSP，The Real Time Streaming Protocol)。RTSP本身不传送连续媒体流，而是起到多媒体服务器的控制器作用。具体来说，通信协商的内容可以包含传输格式、音视频编码格式、播放URL信息、以及是否采用TCP(Transmission Control Protocol，传输控制协议)模式的RTP(实时传送协议(Real-time Transport Protocol))传输等信息。传输的控制和协商通过RTSP通道来保证控制信令的可靠性。
在步骤S30，基于WiFi直连通信连接以及通信协商的结果，在智能眼镜与智能设备之间进行数据传输。
基于WiFi直连通信连接以及协商后的传输格式、音视频编码格 式、以及传输模式等信息，可以在智能眼镜与智能设备之间进行数据传输，即，可实现智能眼镜与智能设备之间的交互。智能眼镜用户不需要设置在智能眼镜存在存储卡就可以播放智能设备上的文件，比如影音文件，还可以方便地使用智能设备的定位***和地图应用、运行智能设备和智能眼镜间的交互游戏，此外智能眼镜所拍摄的图像可以实时分享到智能设备上。由此通过本公开的交互方式可以极大提升用户体验。
根据本公开实施例，首先在智能眼镜与智能设备之间通过WiFi建立通信连接；然后在智能眼镜与智能设备之间进行通信协商；并且在通信协商完成后，在智能眼镜与智能设备之间根据通信协商的结果进行数据传输，从而提高了智能眼镜与智能设备之间数据传输的速度，实现了智能眼镜与智能设备之间高速、双向、便捷的连接，提升用户体验。
图2是根据本公开另一实施例的智能眼镜与智能设备交互的方法的流程示意图。
如图2所示，上述实施例中的步骤S10可以包括步骤S100至S103。
在步骤S100，启动智能眼镜与智能设备***，初始化***软件和硬件。
智能眼镜和智能设备***上电启动后，智能眼镜和智能设备的无线传输模块、音频模块、视频模块等分别初始化。
在步骤S101，智能设备在所属通信信道发送搜索信号，并且监听所属通信信道中是否存在智能眼镜，若存在，则将智能眼镜列表显示给用户。
智能眼镜与智能设备直连服务启动后，当智能设备在搜寻智能眼镜时，会向信道中发送信号，并注册***监听响应结果，如果智能设备监听到信道中存在智能眼镜，则将智能眼镜列表显示给用户。
在步骤S102，智能设备接收到用户的选择指令后，选择要连接的智能眼镜，发起连接并进行鉴权。
可以通过用户预先设置的鉴权方式进行鉴权，例如，在智能设 备端输入界面输入预先设置的验证数字、图形等验证码。
在步骤S103，鉴权成功后，智能眼镜与智能设备之间建立WiFi直连通信连接。
图3是根据本公开实施例的在智能眼镜与智能设备之间进行数据传输的方法流程示意图.
如图3所示，上述实施例中步骤S30可以包括步骤S301至S302。
在步骤S301，发送方将准备发送的数据压缩、复用，并添加RTP头部，随后通过UDP(User Datagram Protocol，用户数据报协议)/IP的方式发送至接收方。
在步骤S302，接收方将接收到的数据解封装、解复用、及解压缩后，以呈现并保存数据。
发送方可以为智能眼镜，并且接收方可以为智能设备；或者，发送方可以为智能设备，并且接收方可以为智能眼镜。
发送方先将准备发送的数据压缩，以打包为基本流(PES)格式，再以MPEG2-TS的方式进行数据的融合复用，并添加RTP头部，最后通过UDP/IP的方式传送至接收方。
接收方则将接收到的数据解封装、解复用、及解压缩，以呈现并保存数据。
根据本公开的实施例，通信协商的内容还包括对传输控制权的协商，智能眼镜与智能设备可以基于协商的传输控制权对数据传输进行切换控制，从而可以实现数据传输方向和控制权切换。
在一个实施例中，智能眼镜与智能设备基于协商的传输控制权对数据传输进行切换控制的步骤包括：发送方向接收方发送控制权申请消息；以及接收方接收到发送方的控制权申请消息后，释放当前控制权，同时确认终止当前的数据传送，以完成数据传输方向和控制权切换。
例如，智能设备将准备发送的数据压缩、复用，并添加RTP头部，随后通过UDP/IP的方式发送至智能眼镜，智能眼镜将接收到的数据解封装、解复用、及解压缩，以呈现并保存数据，随后，如果智能眼镜需要向智能设备发送数据，则智能眼镜向智能设备发送控制权 申请信息，智能设备释放控制权，同时确认终止当前的数据传送，以完成数据传输方向和控制权切换。
同理，智能眼镜将准备发送的数据压缩、复用，并添加RTP头部，随后通过UDP/IP的方式发送至智能设备，智能设备将接收到的数据解封装、解复用、及解压缩，以呈现并保存数据，随后，如果智能设备需要向智能眼镜发送数据，则智能设备向智能眼镜发送控制权申请信息，智能眼镜释放控制权，同时确认终止当前的数据传送，以完成数据传输方向和控制权切换。
通过在传输操控信令加上RTP头部，并通过TCP/IP方式传送，保证了信令的可靠性。双方可以协商对传输的控制权，实现双向传输和控制。
通过数据传输方向和控制权的切换，使得智能设备上存储的信息(比如拍摄到的图像)和智能眼镜上的数据可以在智能设备和智能眼镜之间进行高速、双向传送，智能设备和智能眼镜交互也更加便捷，从而提升了用户体验。
在步骤S302之后，发送方可以向接收方发送断开通信连接的指令，接收方可以根据该指令断开通信连接。
发送方既可以为智能眼镜，也可以为智能设备；相应的，接收方既可以为智能设备，也可以为智能眼镜。
下面结合图4对根据本公开实施例的智能眼镜与智能设备交互的方法的架构进行详细阐述。
如图4所示，智能眼镜与智能设备交互的方法的架构由下至上包括：物理链路层、网络层、传输层、复用层和应用层。
在物理链路层采用WiFi直连，从而脱离了路由器束缚，无线设备以点对点方式互连，而且在传输速度与传输距离方面则比蓝牙等有大幅提升。
在网络层使用IP协议，并且在传输层采用TCP\UDP协议，其中TCP用于传输控制信令以保证控制的可靠性。RTSP和RTP用来保证通信的可靠和实时，RTSP提供了一个可扩展的框架，使传输受控，使得实时数据能够有效地通过IP网络传送多媒体数据。
再上面是复用层和音视频的编解码。最上层是用户应用，负责多媒体呈现和控制。
下面以智能设备向智能眼镜分享数据为例来描述智能眼镜与智能设备的交互流程，如图5所示。
A、上电过程
智能眼镜和设备***上电启动，无线传输模块、音视频模块(上述模块可以根据功能需要设置)分别初始化完毕。
B、WiFi直连通路建立
两个设备的WiFi直连服务启动，当智能设备在搜寻智能眼镜时，会向信道中发送信号，并通过***监听响应结果。采用WiFi直连方式可以无需路由器支持而实现一对一直连，并且WiFi直连标准将会支持所有的WiFi设备，支持2.4GHz或5GHz频率，可实现传统WiFi(最高802.11n)的传输速度与覆盖范围，并可采用WPA2标准加密。
C、通信协商
这种通信方式遵循支持实时数据的RTSP。RTSP本身不传送连续媒体流，而是起到多媒体服务器的控制器作用。具体来说，通信协商的内容可以包含传输格式、音视频编码格式、播放URL信息、以及是否采用TCP模式的RTP传输等信息。传输的控制和协商通过RTSP通道来保证控制信令的可靠性。双向控制在RTSP的基础上增加了控制权申请流程，当发送终端收到接收终端的控制权申请消息后，发送终端释放控制权，同时确认终止当前的数据传送，以完成数据传输方向和控制权切换。
D、屏幕传送与呈现
从发送端来看，整个数据交互的流程包括：先将准备发送的数据压缩，以打包为基本流(PES)格式，再以MPEG2-TS的方式进行多媒体数据的融合复用，并添加RTP头部，最后通过UDP/IP的方式传送。
接收端将接收的数据解封装、解复用、及解压缩后，以呈现，例如，多媒体数据。
此外，智能设备和智能眼镜端均可发起断开连接。
与现有的智能眼镜基于蓝牙物理层进行交互的技术相比，本公 开提出了基于WiFi直连技术的实现方案，使得交互传输速度可达1M/s以上，带宽不再成为瓶颈。本公开的实施例采用经过实践不断改造、优化的协议组，既能够保证交互的实时性，又能够保证了交互的安全可靠；既可对多媒体数据镜像传输，又可对数据进行实时保存。根据本公开提出的交互式双向控制方案，可以在一次连接中交换控制权，实现了智能设备与智能眼镜之间的双向传输和控制。智能设备可以向智能眼镜分享影音和应用呈现，同时智能眼镜也可以向智能设备传输所拍摄的图像等信息。
本公开实施例还提出一种交互***，包括智能眼镜与智能设备，其中，在智能眼镜与智能设备之间建立WiFi直连通信连接后，在智能眼镜与智能设备之间进行通信协商，并且基于WiFi直连通信连接以及通信协商的结果，在智能眼镜与智能设备之间进行数据传输。
本公开实施例还提出一种交互***，包括智能眼镜、智能设备、存储器和处理器。在存储器上存储有计算机程序，所述计算机程序被处理器运行时，所述处理器执行步骤：在智能眼镜与智能设备之间通过WiFi建立通信连接；在智能眼镜与智能设备之间进行通信协商；以及在智能眼镜与智能设备之间根据所述通信协商进行数据传输。
智能设备可以是手机、ipad、电脑等具有无线通信连接功能的终端设备。
如图6所示，根据本实施例的智能眼镜与智能设备交互的***所在终端可以包括处理器1001(例如CPU)、网络接口1004、用户接口1003、存储器1005和通信总线1002。通信总线1002提供了这些组件之间的连接通信。用户接口1003可以包括显示屏和输入单元(比如键盘)。用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线网络接口、无线网络接口(如WI-FI接口)。存储器1005可以是高速RAM存储器，也可以是非易失性存储器，例如磁盘存储器。存储器100可以是独立于处理器1001的存储装置。
本领域技术人员可以理解，图6中示出的终端结构并不构成对终端的限定，可以包括比图示更多或更少的部件，或者组合某些部件， 或者不同的部件布置。
如图6所示，作为一种计算机存储介质的存储器1005中可以包括操作装置、网络通信模块、用户接口模块以及用于智能眼镜与智能设备交互的应用程序。
在图6所示的终端中，网络接口1004用于连接网络服务器，并与网络服务器进行数据通信；用户接口1003用于连接客户端(用户端)，并与客户端进行数据通信；处理器1001用于调用存储器1005中存储的用于智能眼镜与智能设备交互的计算机程序，并执行根据本公开各实施例的智能眼镜与智能设备交互的方法。
此外，本公开实施例还提出一种计算机可读存储介质，其上存储有计算机程序，由处理器运行所述计算机程序时，所述处理器执行根据本公开各实施例的智能眼镜与智能设备交互的方法。
本领域普通技术人员可以理解，上文中所公开方法中的全部或某些步骤、***、装置中的功能模块/单元可以被实施为软件、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些物理组件或所有物理组件可以被实施为由处理器，如中央处理器、数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。这样的软件可以分布在计算机可读介质上，计算机可读介质可以包括计算机存储介质(或非暂时性介质)和通信介质(或暂时性介质)。如本领域普通技术人员公知的，术语计算机存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、程序模块或其他数据)的任何方法或技术中实施的易失性和非易失性、可移除和不可移除介质。计算机存储介质包括但不限于RAM、ROM、EEPROM、闪存或其他存储器技术、CD-ROM、数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、程序模块或者诸如载波或其他 传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。
以上所述仅为本公开的优选实施例，并非因此限制本公开的专利范围，凡是利用本公开说明书及附图内容所作的等效结构或流程变换，或直接或间接运用在其它相关的技术领域，均同理包括在本公开的专利保护范围内。

Claims (16)

  1. 一种智能眼镜与智能设备交互的方法，包括：
    在所述智能眼镜与所述智能设备之间建立WiFi直连通信连接；
    在所述智能眼镜与所述智能设备之间进行通信协商；以及
    基于所述WiFi直连通信连接以及通信协商的结果，在所述智能眼镜与所述智能设备之间进行数据传输。
  2. 根据权利要求1所述的智能眼镜与智能设备交互的方法，其中，所述智能眼镜与所述智能设备之间建立WiFi直连通信连接的步骤包括：
    所述智能设备在所属通信信道发送搜索信号，并且监听所属通信信道中是否存在智能眼镜，若存在，则基于监听到的智能眼镜生成智能眼镜列表显示给用户；
    所述智能设备接收到用户的选择指令后，选择要连接的智能眼镜，发起连接并进行鉴权；以及
    在鉴权成功后，在所述智能眼镜与所述智能设备之间建立WiFi直连通信连接。
  3. 根据权利要求2所述的智能眼镜与智能设备交互的方法，其中，在所述智能眼镜与所述智能设备之间进行数据传输的步骤包括：
    发送方将准备发送的数据压缩、复用，并添加实时传送协议头部，随后通过UDP/IP的方式发送至接收方；以及
    所述接收方将接收到的数据解封装、解复用、及解压缩，以呈现并保存数据；
    其中，所述发送方为所述智能眼镜和所述智能设备中的一者，并且所述接收方为所述智能眼镜和所述智能设备中的另一者。
  4. 根据权利要求3所述的智能眼镜与智能设备交互的方法，其中，所述通信协商的内容包括传输格式、音视频编码格式、以及传输 模式中的至少之一。
  5. 根据权利要求4所述的智能眼镜与智能设备交互的方法，其中，所述通信协商的内容还包括对传输控制权的协商，并且所述方法还包括：
    所述智能眼镜与所述智能设备基于协商的传输控制权对数据传输进行切换控制。
  6. 根据权利要求5所述的智能眼镜与智能设备交互的方法，其中，所述智能眼镜与所述智能设备基于协商的传输控制权对数据传输进行切换控制的步骤包括：
    所述发送方向所述接收方发送控制权申请消息；以及
    所述接收方接收到所述发送方的控制权申请消息后，释放当前控制权，同时确认终止当前的数据传送，以完成数据传输方向和控制权切换。
  7. 根据权利要求3所述的智能眼镜与智能设备交互的方法，其中，在所述智能眼镜与所述智能设备之间进行数据传输的步骤之后还包括：
    所述发送方向所述接收方发送断开通信连接的指令；以及
    所述接收方根据所述指令断开通信连接。
  8. 一种交互***，包括智能眼镜与智能设备，其中，
    在所述智能眼镜与所述智能设备之间建立WiFi直连通信连接后，在所述智能眼镜与所述智能设备之间进行通信协商，并且
    基于所述WiFi直连通信连接以及通信协商的结果，在所述智能眼镜与所述智能设备之间进行数据传输。
  9. 根据权利要求8所述的交互***，其中，
    所述智能设备在所属通信信道发送搜索信号，并且监听所属通 信信道中是否存在智能眼镜，若存在，则基于监听到的智能眼镜生成智能眼镜列表显示给用户；
    所述智能设备接收到用户的选择指令后，选择要连接的智能眼镜，发起连接并进行鉴权；以及
    在鉴权成功后，在所述智能眼镜与所述智能设备之间建立WiFi直连通信连接。
  10. 根据权利要求9所述的交互***，其中，
    发送方将准备发送的数据进行压缩、复用，并添加实时传送协议头部，随后通过UDP/IP的方式发送至接收方；以及
    所述接收方将接收到的数据进行解封装、解复用、及解压缩，以呈现并保存数据；
    其中，所述发送方为所述智能眼镜和所述智能设备中的一者，并且所述接收方为所述智能眼镜和所述智能设备中的另一者。
  11. 根据权利要求10所述的交互***，其中，所述通信协商的内容包括传输格式、音视频编码格式、以及传输模式中的至少之一。
  12. 根据权利要求11所述的交互***，其中，所述通信协商的内容中还包括对传输控制权的协商，并且
    所述智能眼镜与所述智能设备基于协商的传输控制权对数据传输进行切换控制。
  13. 根据权利要求12所述的交互***，其中，
    所述发送方向所述接收方发送控制权申请消息；以及
    所述接收方接收到所述发送方的控制权申请消息后，释放当前控制权，同时确认终止当前的数据传送，以完成数据传输方向和控制权切换。
  14. 根据权利要求10所述的交互***，其中，
    所述发送方向所述接收方发送断开通信连接的指令，并且
    所述接收方根据所述指令断开通信连接。
  15. 一种交互***，包括：智能眼镜、智能设备、存储器以及处理器，所述存储器上存储有计算机程序，当所述处理器运行所述计算机程序时，所述处理器执行根据权利要求1至7中任一项所述的所述智能眼镜与所述智能设备交互的方法。
  16. 一种计算机可读存储介质，其上存储有计算机程序，当处理器运行所述计算机程序时，所述处理器执行根据权利要求1至7中任一项所述的智能眼镜与智能设备交互的方法。
PCT/CN2018/124196 2017-12-29 2018-12-27 智能眼镜与智能设备交互的方法、***及存储介质 WO2019129125A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/768,695 US11304247B2 (en) 2017-12-29 2018-12-27 Method and system for interaction between smart glasses and smart device, and storage medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711498548.3A CN109996348B (zh) 2017-12-29 2017-12-29 智能眼镜与智能设备交互的方法、***及存储介质
CN201711498548.3 2017-12-29

Publications (1)

Publication Number Publication Date
WO2019129125A1 true WO2019129125A1 (zh) 2019-07-04

Family

ID=67066681

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/124196 WO2019129125A1 (zh) 2017-12-29 2018-12-27 智能眼镜与智能设备交互的方法、***及存储介质

Country Status (3)

Country Link
US (1) US11304247B2 (zh)
CN (1) CN109996348B (zh)
WO (1) WO2019129125A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114615675A (zh) * 2021-04-22 2022-06-10 苏州萝卜电子科技有限公司 用于智能眼镜的通信方法及***
CN113329375B (zh) * 2021-05-27 2023-06-27 Oppo广东移动通信有限公司 内容处理方法、装置、***、存储介质和电子设备
CN113556423B (zh) * 2021-07-15 2023-04-07 Oppo广东移动通信有限公司 信息处理方法、装置、***、存储介质和电子设备

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103813330A (zh) * 2012-11-15 2014-05-21 中兴通讯股份有限公司 一种通信终端、***以及权限管理方法
CN104427381A (zh) * 2013-08-27 2015-03-18 中兴通讯股份有限公司 播放方法及装置
CN104584490A (zh) * 2014-05-28 2015-04-29 华为技术有限公司 数据发送方法及装置
CN105125088A (zh) * 2015-07-24 2015-12-09 小米科技有限责任公司 智能提示电饭锅信息的方法及装置
US20170208641A1 (en) * 2013-10-17 2017-07-20 Samsung Electronics Co., Ltd. Method for connection between electronic devices and electronic device thereof
CN107506039A (zh) * 2017-08-28 2017-12-22 努比亚技术有限公司 移动终端、数据传输方法及计算机存储介质

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9203252B2 (en) * 2013-11-12 2015-12-01 Google Inc. Redirecting notifications to a wearable computing device
CN104614706A (zh) * 2014-12-24 2015-05-13 青岛歌尔声学科技有限公司 一种眼镜定位方法、装置、一种智能终端和一种定位***
US10805781B2 (en) * 2015-03-05 2020-10-13 Samsung Electronics Co., Ltd. Method and apparatus for establishing a connection between devices
US10129892B2 (en) * 2015-06-01 2018-11-13 Qualcomm Incorporated Techniques to manage reverse channel audio sessions
CN104967887B (zh) * 2015-06-06 2018-03-30 深圳市虚拟现实科技有限公司 基于nfc的信息交互方法和虚拟现实眼镜
CN107133028B (zh) * 2017-03-30 2021-07-16 联想(北京)有限公司 一种信息处理方法及电子设备

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103813330A (zh) * 2012-11-15 2014-05-21 中兴通讯股份有限公司 一种通信终端、***以及权限管理方法
CN104427381A (zh) * 2013-08-27 2015-03-18 中兴通讯股份有限公司 播放方法及装置
US20170208641A1 (en) * 2013-10-17 2017-07-20 Samsung Electronics Co., Ltd. Method for connection between electronic devices and electronic device thereof
CN104584490A (zh) * 2014-05-28 2015-04-29 华为技术有限公司 数据发送方法及装置
CN105125088A (zh) * 2015-07-24 2015-12-09 小米科技有限责任公司 智能提示电饭锅信息的方法及装置
CN107506039A (zh) * 2017-08-28 2017-12-22 努比亚技术有限公司 移动终端、数据传输方法及计算机存储介质

Also Published As

Publication number Publication date
US20210176803A1 (en) 2021-06-10
CN109996348A (zh) 2019-07-09
CN109996348B (zh) 2022-07-05
US11304247B2 (en) 2022-04-12

Similar Documents

Publication Publication Date Title
CN105229988B (zh) 在对接结构中的基于代理的通信方法和设备
KR102127357B1 (ko) 디스플레이 세션에서 오프라인 참여를 위한 무선 통신 시스템 및 방법
AU2015386336B2 (en) Information processing device, information processing method, and program
US10425454B2 (en) Device and method for transferring the rendering of multimedia content
US10841165B2 (en) Information processing apparatus, and information processing method that change data transmission roles of different devices
CN105828151B (zh) 一种显示处理方法及装置
US20130346562A1 (en) Data transmission method and apparatus for mobile terminal
WO2019129125A1 (zh) 智能眼镜与智能设备交互的方法、***及存储介质
EP3032838A1 (en) Message processing method, device, gateway, set-top box and internet protocol television system
WO2018103733A1 (zh) 一种控制方法及设备
CN103561281B (zh) 一种多媒体数据共享的方法及装置
CN110943977B (zh) 多媒体业务数据传输方法、服务端、设备及存储介质
WO2014161403A1 (zh) 视频会议电视终端视频源的接入方法和***
US10129892B2 (en) Techniques to manage reverse channel audio sessions
CN114710568B (zh) 音视频数据通信方法、设备及存储介质
WO2015169005A1 (zh) 共享屏幕和操作控制的方法、***和主共享端
WO2014082294A1 (zh) 一种媒体流传输方法及相关设备、***
WO2016177257A1 (zh) 一种数据分享的方法和装置
WO2024108900A1 (zh) 一种电子签名验证方法及装置
CN112653925B (zh) 媒体播放的跨设备转移方法、***、设备及存储介质
CN116319707A (zh) 一种监控设备音视频流的分发方法、***、设备和介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18895163

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 18.11.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 18895163

Country of ref document: EP

Kind code of ref document: A1