CN115426335B - Information interaction method, device, equipment and system - Google Patents
Information interaction method, device, equipment and system Download PDFInfo
- Publication number
- CN115426335B CN115426335B CN202110521431.2A CN202110521431A CN115426335B CN 115426335 B CN115426335 B CN 115426335B CN 202110521431 A CN202110521431 A CN 202110521431A CN 115426335 B CN115426335 B CN 115426335B
- Authority
- CN
- China
- Prior art keywords
- terminal
- resource
- resource platform
- media channel
- augmented reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 71
- 230000003993 interaction Effects 0.000 title claims abstract description 52
- 230000003190 augmentative effect Effects 0.000 claims abstract description 60
- 230000005540 biological transmission Effects 0.000 claims abstract description 28
- 238000012545 processing Methods 0.000 claims description 46
- 230000004044 response Effects 0.000 claims description 39
- 238000004590 computer program Methods 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 19
- 230000000694 effects Effects 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- 230000011664 signaling Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000000354 decomposition reaction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 230000006798 recombination Effects 0.000 description 2
- 238000005215 recombination Methods 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/1066—Session management
- H04L65/1069—Session establishment or de-establishment
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0807—Network architectures or network communication protocols for network security for authentication of entities using tickets, e.g. Kerberos
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Multimedia (AREA)
- Mobile Radio Communication Systems (AREA)
Abstract
The invention provides an information interaction method, device, equipment and system, wherein the information interaction method of an Augmented Reality (AR) resource platform side comprises the following steps: establishing session connection with an augmented reality AR terminal supporting the universal interface through the universal interface; through the session connection, AR resources are allocated to the AR terminal; when determining that the AR terminal is allowed to use AR resources, establishing media channel connection with the AR terminal; and carrying out data transmission with the AR terminal through the media channel connection. The scheme of the invention enables the AR terminal to fully utilize the computing capability and data resources of the AR resource platform, expands the AR application function and improves the performance of the AR terminal.
Description
Technical Field
The present invention relates to the field of communications technologies, and in particular, to an information interaction method, apparatus, device, and system.
Background
Current Augmented Reality (AR) applications are typically implemented by terminals such as AR glasses, including obtaining AR material from local storage or sensors; and calculating the AR material, extracting key information, and responding to the key information, the overlapped display of the view field and the like. With the construction of 5G infrastructure, the wireless network has the advantages of high speed, high bandwidth and low time delay.
The traditional AR application processing method dispatches some local computing tasks to a server side at a network side, so that the server side can provide resources to provide service capability for an AR terminal.
By adopting a traditional AR application processing method, the AR resource of the server side has single function; and the interface is closed, so that service can not be provided for the third-party AR terminal, and the expansibility is poor.
Disclosure of Invention
The invention aims to provide an information interaction method, device, equipment and system. The computing capability and data resources of the cloud resource platform can be fully utilized by the AR terminal, the AR application function is expanded, and the performance of the AR terminal is improved.
In order to solve the technical problems, the technical scheme of the invention is as follows:
an information interaction method applied to an Augmented Reality (AR) resource platform, the method comprising:
establishing session connection with an augmented reality AR terminal supporting the universal interface through the universal interface;
through the session connection, AR resources are allocated to the AR terminal;
when determining that the AR terminal is allowed to use AR resources, establishing media channel connection with the AR terminal;
and carrying out data transmission with the AR terminal through the media channel connection.
Optionally, establishing a session connection with the augmented reality AR terminal includes:
receiving a session connection establishment request sent by the AR terminal;
and feeding back a session connection establishment response message to the AR terminal according to the session connection establishment request, wherein the session connection establishment response message carries information for agreeing to establish session connection and a session identifier.
Optionally, through the session connection, allocating AR resources to the AR terminal includes:
receiving a resource request message sent by the AR terminal;
according to the resource request message, AR resources are allocated to the AR terminal, and an allocation result is sent to the AR terminal, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word and a challenge algorithm.
Optionally, when determining that the AR terminal is allowed to use AR resources, establishing a media channel connection with the AR terminal, including:
authentication is carried out on the AR terminal;
after passing the authentication, determining that the AR terminal is allowed to use AR resources;
and establishing media channel connection with the AR terminal when determining that the AR terminal is allowed to use the AR resources.
Optionally, authenticating the AR terminal includes:
Receiving an authentication request sent by the AR terminal, wherein the authentication request carries terminal information of the AR terminal and a first token, and the first token is obtained by calculating an AR terminal according to a challenge word and a challenge algorithm sent by the AR resource platform and a key of the AR terminal;
calculating to obtain a second token according to the challenge word and the challenge algorithm and the secret key;
and if the second token is the same as the first token, feeding back an authentication passing response to the AR terminal.
Optionally, establishing media channel connection with the AR terminal includes:
receiving a media channel connection request sent by the AR terminal;
according to the media channel connection request, AR resource initialization and media channel connection port establishment are carried out, and asynchronous event information is fed back to the AR terminal;
and after receiving the response message of the asynchronous event message sent by the AR terminal, establishing media channel connection with the AR terminal.
Optionally, the data transmission with the AR terminal through the media channel connection includes:
receiving data sent by the AR terminal through the media channel connection;
processing the data according to the asynchronous event message to obtain a processing result;
And feeding back the processing result to the AR terminal through the media channel connection.
The embodiment of the invention also provides an information interaction method which is applied to the augmented reality AR terminal supporting the universal interface, and the method comprises the following steps:
establishing session connection with an augmented reality AR resource platform through a universal interface;
through the session connection, AR resources are allocated to the AR terminal;
when determining that AR resources are allowed to be used, establishing media channel connection with the AR resource platform;
and carrying out data transmission with the AR resource platform through the media channel connection.
Optionally, establishing a session connection with the augmented reality AR resource platform includes:
sending a session connection establishment request to the AR resource platform;
and receiving a session connection establishment response fed back by the AR resource platform, wherein the session connection establishment response carries information for agreeing to establish the session connection and a session identifier.
Optionally, through the session connection, allocating AR resources to the AR terminal includes:
sending a resource request message to the AR resource platform;
and receiving an allocation result obtained by the AR resource platform for allocating AR resources to the AR terminal according to the resource request message, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word and a challenge algorithm.
Optionally, when determining that the AR terminal is allowed to use AR resources, establishing a media channel connection with the AR terminal, including:
performing authentication with the AR resource platform;
after the authentication passes, determining that the AR resource is allowed to be used;
and establishing media channel connection with the AR resource platform when the AR resource is determined to be allowed to be used.
Optionally, the interaction with the AR resource platform performs authentication, including:
calculating to obtain a first token according to the challenge word and the challenge algorithm sent by the AR resource platform and the key of the AR terminal;
sending an authentication request to the AR resource platform, wherein the authentication request carries terminal information of an AR terminal and a first token;
and after receiving the terminal information and the token authentication pass by the AR resource platform, the feedback authentication passes the response.
Optionally, establishing a media channel connection with the AR resource platform includes:
sending a media channel connection request to the AR resource platform;
receiving an asynchronous event message fed back to the AR terminal after the AR resource platform initializes the AR resources and establishes a media channel connection port according to the media channel connection request;
And sending a response message of the asynchronous event message to the AR resource platform, and establishing media channel connection with the AR resource platform.
Optionally, the data transmission is performed through the media channel connection, including:
data sent to the AR resource platform through the media channel connection;
and receiving a processing result fed back by the AR resource platform according to the processing of the data by the asynchronous event message.
The embodiment of the invention also provides an information interaction method, which comprises the following steps:
the AR resource platform establishes session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
the AR resource platform distributes AR resources for the AR terminal through the session connection;
when the AR resource platform determines that the AR terminal is allowed to use AR resources, media channel connection is established with the AR terminal;
and the AR resource platform is connected with the AR terminal through the media channel and performs data transmission with the AR terminal.
The embodiment of the invention also provides an information interaction device which is applied to the augmented reality AR resource platform, and the device comprises:
the receiving and transmitting module is used for establishing session connection with an augmented reality AR terminal supporting the universal interface through the universal interface;
The processing module is used for distributing AR resources to the AR terminal through the session connection;
the receiving-transmitting module is further used for establishing media channel connection with the AR terminal when determining that the AR terminal is allowed to use AR resources; and carrying out data transmission with the AR terminal through the media channel connection.
The embodiment of the invention also provides an augmented reality AR resource platform which comprises the information interaction device.
The embodiment of the invention also provides an information interaction device which is applied to the augmented reality AR terminal supporting the universal interface, and the device comprises:
the receiving and transmitting module is used for establishing session connection with the augmented reality AR resource platform through the universal interface;
the processing module is used for obtaining the allocation of AR resources for the AR terminal through the session connection;
the receiving and transmitting module is also used for establishing media channel connection with the AR resource platform when determining that the AR resource is allowed to be used; and carrying out data transmission with the AR resource platform through the media channel connection.
The embodiment of the invention also provides an augmented reality AR terminal, which comprises: an information interaction device as described above.
The embodiment of the invention also provides an information interaction system, which comprises: the AR resource platform;
The AR resource platform establishes session connection with the AR terminal supporting the universal interface through the universal interface;
the AR resource platform distributes AR resources for the AR terminal through the session connection;
when the AR resource platform determines that the AR terminal is allowed to use AR resources, media channel connection is established with the AR terminal;
and the AR resource platform is connected with the AR terminal through the media channel and performs data transmission with the AR terminal.
The embodiment of the invention also provides a processing device, which comprises: a processor, a memory storing a computer program which, when executed by the processor, performs the method as described above.
Embodiments of the present invention also provide a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform a method as described above.
The scheme of the invention at least comprises the following beneficial effects:
establishing session connection with an augmented reality AR terminal supporting a universal interface through the universal interface by an AR resource platform; through the session connection, AR resources are allocated to the AR terminal; when determining that the AR terminal is allowed to use AR resources, establishing media channel connection with the AR terminal; and carrying out data transmission with the AR terminal through the media channel connection. The method has the advantages that the AR cloud resource platform and the AR terminal universal interface standard are unified, and the AR cloud resource platform and the AR terminal universal interface standard are provided for the AR terminal in a standard interface mode, so that the AR terminal can fully utilize the computing capacity and data resources of the cloud resource platform, expand AR application functions and improve the performance of the AR terminal.
Drawings
Fig. 1 is a flow chart of an information interaction method at an AR resource platform side according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating the interaction between an AR terminal and an AR resource platform according to an embodiment of the present invention;
FIG. 3 is another flow chart illustrating the interaction of an AR terminal with an AR resource platform according to an embodiment of the present invention;
FIG. 4 is a schematic block diagram of an information interaction device on the AR resource platform side according to an embodiment of the present invention;
FIG. 5 is a block diagram of an embodiment of an AR resource platform according to the present invention;
FIG. 6 is a schematic diagram of a specific implementation example of an interaction between an AR terminal and an AR resource platform according to an embodiment of the present invention;
fig. 7 is a flowchart of an information interaction method at the AR terminal side according to an embodiment of the present invention.
Detailed Description
Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
As shown in fig. 1, an embodiment of the present invention provides an information interaction method applied to an augmented reality AR resource platform, the method including:
Step 11, establishing session connection with the augmented reality AR terminal through a universal interface;
step 12, through the session connection, AR resources are allocated to the AR terminal;
step 13, when determining that the AR terminal is allowed to use AR resources, establishing media channel connection with the AR terminal;
and step 14, performing data transmission with the AR terminal through the media channel connection.
In this embodiment of the present invention, the universal interface standard between the AR resource platform and the AR terminal is carried by websocket communication, the data format conforms to json specification, and is encrypted by the ssl (secure socket layer) certificate. Establishing session connection with an augmented reality AR terminal through an AR resource platform; through the session connection, AR resources are allocated to the AR terminal; when determining that the AR terminal is allowed to use AR resources, establishing media channel connection with the AR terminal; and carrying out data transmission with the AR terminal through the media channel connection. The AR cloud resource platform and the AR terminal universal interface standard are unified, and the AR terminal is provided with the AR terminal in a standard interface mode, so that the AR terminal can fully utilize the computing capacity and data resources of the cloud resource platform, expand AR application functions and improve the performance of the AR terminal.
In an alternative embodiment of the present invention, step 11 may include:
step 111, receiving a session connection establishment request sent by the AR terminal;
step 112, according to the session connection establishment request, a session connection establishment response is fed back to the AR terminal, where the session connection establishment response carries information for agreeing to establish a session connection and a session identifier.
As shown in fig. 2, in a specific implementation, the step 11 may include:
n1: after the AR terminal is powered on, a create request needs to be sent to the AR resource platform to establish a session. Wherein the parameter value "create" indicates that the communication session is requested to be established, and the parameter "transaction" identifies one request and one response and is randomly generated by the terminal;
n2: the AR resource platform synchronously replies a response to the AR terminal. The parameter "result" identifies whether the AR resource platform agrees to establish a session with the AR terminal, for example, the value of "result" is success, which indicates that the AR terminal agrees to establish a session with the AR terminal. The parameter "transaction" is consistent with the request parameter for the AR terminal to verify. The parameter "data" carries the session ID, which is generated by the AR resource platform and added to all subsequent signaling of the session.
In an alternative embodiment of the present invention, step 12 may include:
Step 121, receiving a resource request message sent by the AR terminal;
step 122, according to the resource request message, AR resources are allocated to the AR terminal, and an allocation result is sent to the AR terminal, where the allocation result includes a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word, and a challenge algorithm.
As shown in fig. 2, in a specific implementation, the step 12 may include:
and N3: after the session is established, the AR terminal needs to initiate a resource request message according to the service scenario. Where the parameter value "attach" indicates the resource engine request and the parameter "resource" identifies which type of AR resource is requested. The parameter values are defined in terms of "{ vendor } { type } { resource name } { version }, e.g., the cmcc.video.facedetect.v1 identifier is the face recognition engine v1 version of vendor a. The request parameter needs to carry the session ID fed back by the AR resource platform and a new transaction ID generated by the AR terminal.
N4: and the AR resource platform allocates AR resources for the terminal and synchronously replies and responds the allocation result to the AR terminal. The parameter "result" identifies whether the AR resource platform agrees to establish a session with the AR terminal, and when the response resource in the AR resource platform is insufficient, feedback failure information is sent to the AR terminal. The parameter "transaction" is consistent with the request parameter for the AR terminal to verify. The parameter "session_id" carries the session ID. The parameter "ID" carries the resource ID newly generated by the AR resource platform, and is generated by the AR resource platform, and the resource ID needs to be added to all the request signaling of the subsequent session for the resource. The parameters "nonce" and "algorithm" carry the challenge word and the challenge algorithm for the AR terminal to compute the token.
In an alternative embodiment of the present invention, step 13 may include:
step 131, authenticating the AR terminal;
step 132, after the authentication passes, determining that the AR terminal is allowed to use AR resources;
and step 133, establishing media channel connection with the AR terminal when determining that the AR terminal is allowed to use the AR resources.
Optionally, authenticating the AR terminal includes:
receiving an authentication request sent by the AR terminal, wherein the authentication request carries terminal information of the AR terminal and a first token, and the token is obtained by calculating an AR terminal according to a challenge word and a challenge algorithm sent by the AR resource platform and a secret key local to the AR terminal;
calculating to obtain a second token according to the challenge word and the challenge algorithm and the secret key;
and if the second token is the same as the first token, feeding back an authentication passing response to the AR terminal.
As shown in fig. 2, when the authentication is specifically implemented, the step of performing authentication on the AR terminal may include:
n5: the AR terminal calculates a token by combining the local key according to the challenge word and the challenge algorithm, and sends the user name and the token as authentication request parameters to the AR resource platform. Wherein the value of the parameter "request" is "register".
N6: the AR resource platform calculates the token through the same operation method, if the token calculated by the AR resource platform is consistent with the AR terminal, the AR terminal is considered to be effective, the AR terminal is allowed to use the applied resource, otherwise, the resource is released and the connection with the terminal is interrupted. When the AR terminal is allowed to use the resources, the AR resource platform informs the AR terminal through a synchronous response message carrying 'registered' information.
N7: after the AR terminal obtains authentication passing response, media connection with the AR resource platform is started to be established. The AR terminal sends a "join" request and its request parameters to the AR resource platform. Taking face recognition resources as an example, the request parameters include width ", height", frame rate "fps", minimum code rate "minbr", initial code rate "initbr" and maximum code rate "maxbr".
In an optional embodiment of the present invention, in step 133, establishing a media channel connection for the AR terminal includes:
step 1331, receiving a media channel connection request sent by the AR terminal;
step 1332, initializing AR resources and establishing ports of media channel connection according to the media channel connection request, and feeding back asynchronous event messages to the AR terminal;
Step 1333, after receiving the response message of the asynchronous event message sent by the AR terminal, establishing a media channel connection with the AR terminal.
As shown in fig. 3, in a specific implementation, step 133 may include:
n8: the AR resource platform gives a synchronous response ack, and identifies that the request is received, and the resource initialization and the media port establishment work are ongoing.
N9: the AR resource platform completes the resource initialization and media port establishment work and feeds back asynchronous event information to the AR terminal. Wherein the value "event" of the parameter "oper" identifies the message as an asynchronous event. The "resourcedata" carries notification content including an event type "sdp" identified by a parameter "event" and its associated parameters "type" and "dp". The Sdp protocol is a session description protocol used for the AR resource platform and the AR terminal to establish a media session. Here the AR resource platform offer gives an dp to the AR terminal.
N10: after receiving the dp information from the AR resource platform, the AR terminal generates local response dp information, and feeds the terminal side dp back to the AR resource platform through an accept request. Sdp is carried by the parameters "type" and "dp".
N11: and the AR resource platform receives the terminal side sdp information and processes the terminal side sdp information, so that the media channel connection between the AR resource platform and the AR terminal is established. And then, the AR terminal encodes and transmits the locally acquired video to an AR resource platform, and relevant resources prepared by the AR resource platform are processed and identified.
N12: after the AR resource platform recognizes the face information, the recognition result is issued to the AR terminal through the asynchronous event message. The recognition result is carried by the child element "data" of "resource data". The members of the recognition result may be different depending on the AR engine. Taking the face recognition AR engine as an example, the recognition result includes an image total width ", an image total height", one or more face information, and the like.
In an alternative embodiment of the present invention, step 14 may include:
step 141, receiving data sent by the AR terminal through the media channel connection;
step 142, processing the data according to the asynchronous event message to obtain a processing result;
and step 143, feeding back the processing result to the AR terminal through the media channel connection.
In this embodiment, the data sent by the AR terminal may be: audio stream data, video stream data, or other files or data of related information other than audio stream data, video stream data.
Specific implementations of the above embodiments are described below in conjunction with fig. 4, 5 and 6:
as shown in fig. 4, an embodiment of the present invention further provides an information interaction device 40, applied to an augmented reality AR resource platform, where the device 40 includes:
A transceiver module 41, configured to establish a session connection with an augmented reality AR terminal supporting the universal interface through the universal interface;
a processing module 42, configured to allocate AR resources to the AR terminal through the session connection;
the transceiver module 41 is further configured to establish a media channel connection with the AR terminal when determining that the AR terminal is allowed to use AR resources; and carrying out data transmission with the AR terminal through the media channel connection.
Optionally, establishing session connection with an augmented reality AR terminal supporting the universal interface through the universal interface includes:
receiving a session connection establishment request sent by the AR terminal;
and feeding back a session connection establishment response message to the AR terminal according to the session connection establishment request, wherein the session connection establishment response message carries information for agreeing to establish session connection and a session identifier.
Optionally, through the session connection, allocating AR resources to the AR terminal includes:
receiving a resource request message sent by the AR terminal;
according to the resource request message, AR resources are allocated to the AR terminal, and an allocation result is sent to the AR terminal, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word and a challenge algorithm.
Optionally, when determining that the AR terminal is allowed to use AR resources, establishing a media channel connection with the AR terminal, including:
authentication is carried out on the AR terminal;
after passing the authentication, determining that the AR terminal is allowed to use AR resources;
and establishing media channel connection with the AR terminal when determining that the AR terminal is allowed to use the AR resources.
Optionally, authenticating the AR terminal includes:
receiving an authentication request sent by the AR terminal, wherein the authentication request carries terminal information of the AR terminal and a first token, and the first token is obtained by calculating an AR terminal according to a challenge word and a challenge algorithm sent by the AR resource platform and a key of the AR terminal;
calculating to obtain a second token according to the challenge word and the challenge algorithm and the secret key;
and if the second token is the same as the first token, feeding back an authentication passing response to the AR terminal.
Optionally, establishing media channel connection with the AR terminal includes:
receiving a media channel connection request sent by the AR terminal;
according to the media channel connection request, AR resource initialization and media channel connection port establishment are carried out, and asynchronous event information is fed back to the AR terminal;
And after receiving the response message of the asynchronous event message sent by the AR terminal, establishing media channel connection with the AR terminal.
Optionally, the data transmission with the AR terminal through the media channel connection includes:
receiving data sent by the AR terminal through the media channel connection;
processing the data according to the asynchronous event message to obtain a processing result;
and feeding back the processing result to the AR terminal through the media channel connection.
As shown in fig. 5, an embodiment of the present invention further provides an augmented reality AR resource platform, including the information interaction device as described above.
Specifically, the transceiver module may be implemented by at least one of a communication access module, a request distribution module, a voice bus, a video bus, and other data buses;
the processing module may include: at least one of a request sub-terminal management authentication module, a resource management module, a voice processing engine, a video processing engine and other data processing engines is realized;
the AR terminal communicates with the AR resource platform through an N interface; the modules inside the AR resource platform can be realized through a P interface.
Wherein, communication access module: is responsible for providing an IP communication interface and two communication ports, namely a control signaling monitoring port and a media data communication port. The control signaling monitoring port is a fixed TCP port, and the media data communication port is negotiated and established with the AR resource platform and the AR terminal session each time, and the media communication port needs to be closed and released after the session is completed. The ports provided by the communication access module can operate in IPv4 and IPv6, and can operate in a Data Plane Development Kit (DPDK) mode for increasing data throughput.
Request distribution module: and the AR terminal is responsible for receiving the request from the communication access module and completing session management of session_id and transaction described in the communication protocol part. Messages may be routed to a designated AR resource library according to the AR terminal request total carried "resource" request string.
Terminal authentication management module: the authentication management of the terminal is completed, including storing account password information of the AR terminal, generating a working key token challenge word for each communication, calculating the working key token through a specified algorithm, and completing the verification process.
And a resource management module: and managing the AR resource libraries, determining the resource use condition of each resource library, and keeping heartbeats with the resource libraries to determine the health state of the resource libraries. When the AR terminal requests a certain AR resource, the module determines whether the AR resource platform has the resource and whether the resource is idle. After the AR resource finishes processing the media, the processing result is delivered to the resource management module to be issued to the AR terminal.
Voice bus: and the voice media channel is responsible for establishing a voice media channel with the AR terminal, receiving and decoding voice from the AR terminal, and distributing the decoded PCM voice data to a required resource library for further processing. In addition, if the resource library needs to issue audio to the AR terminal, the audio is also transmitted in an encoding way through the audio bus.
A speech processing engine: a series of libraries for processing speech, including but not limited to: speech recognition engines (ASR), text-to-speech engines (TTS), outbound telephony engines, etc.
Video bus: and the video media channel is responsible for establishing a video media channel with the AR terminal, receiving and decoding the video from the AR terminal, and distributing the decoded image data to a required resource library for further processing. In addition, if the resource library needs to issue the video to the AR terminal, the video is also transmitted in a coding way through the video bus.
Video processing engine: a series of repositories for processing video images including, but not limited to: image recognition (face, license plate, certificate, two-dimensional code, etc.) engines, image tracking engines, panoramic image processing engines, 3D image processing engines, image optimization engines, visual computing algorithm engines, spatial localization engines, etc.
Data bus: and the method is responsible for establishing a data channel with the AR terminal, receiving and decoding data from the AR terminal, and distributing the analyzed data information to a required resource library for further processing. In addition, if the resource library needs to send the data stream to the AR terminal, the data stream is also transmitted in a coding way through the data bus. Data transmitted by the data bus such as FBX, model data in OBJ format, synchronous positioning and modeling (SLAM) data, and the like.
Other data processing engines: a series of engines that process AR data and material, including but not limited to: digital twinning engines, digital modeling engines, virtual content engines, etc., where others may include any other data besides audio, video.
As shown in fig. 6, one possible flow includes:
p1: and the communication access module receives the attach request of the AR terminal and forwards the attach request to the request distribution module.
P2: the request distribution module forwards the attach request to the resource management module.
P3: the resource management module confirms the resources to the resource library, and the resource library reserves the corresponding resources.
P4: the resource library feeds back the resource reservation condition to the resource management module.
P5, P6: the resource management module informs the AR terminal of the result through the request distribution module and the communication access module.
P7, P8: the AR terminal initiates an authentication request to be routed to the terminal authentication management module.
P9, P10: the terminal authentication management module completes authentication of the authority of the AR terminal for using the resource, and feeds back the authority to the AR terminal after the authority passes.
P11, P12, P13: the AR terminal initiates a media channel connection establishment request, the request distribution module sends the request to the video bus, and the video bus establishes a media port and feeds the media port back to the request distribution module.
P14, P15: the request distribution module initiates a request for initializing AR resources to the video bus, and the video bus creates AR resource instances through an AR resource library.
P16, P17: the AR resource platform feeds back the media port information to the AR terminal, and the AR terminal also feeds back the media port information to the AR resource platform through the accept request.
P18: media port information fed back by the AR terminal is routed to a video bus through a request distribution module, and the video bus and the AR terminal establish a unidirectional uplink video stream.
P19: the AR terminal compresses and codes the video stream and then sends the video stream to a video bus media port, and the video bus is decoded and then forwarded to an AR resource library.
P20, P21, P22: after the face recognition engine of the AR resource library recognizes the face, the face data is fed back to the AR terminal through the resource management, the request distribution module and the communication access module, and the AR terminal can locally synthesize the AR image for the user to display.
The above embodiment of the invention provides a set of general protocol and AR resource platform implementation mode, which can be used for an operator to construct an AR resource platform as a reference, is beneficial to integrating rich network, data and technical resources of the operator, and provides standardized and accessible services for a plurality of AR terminal manufacturers. The technical threshold of AR terminal manufacturers is reduced, and the service innovation of the AR industry and the AR service development period can be effectively helped.
As shown in fig. 7, an embodiment of the present invention further provides an information interaction method applied to an augmented reality AR terminal supporting a universal interface, the method including:
step 71, establishing session connection with the augmented reality AR resource platform through a universal interface;
step 72, obtaining the allocation of AR resources for the AR terminal through the session connection;
step 73, establishing media channel connection with the AR resource platform when determining that the AR resource is allowed to be used;
and step 74, performing data transmission with the AR resource platform through the media channel connection.
Optionally, establishing session connection with the AR resource platform includes:
sending a session connection establishment request to the AR resource platform;
and receiving a session connection establishment response fed back by the AR resource platform, wherein the session connection establishment response carries information for agreeing to establish the session connection and a session identifier.
Optionally, through the session connection, allocating AR resources to the AR terminal includes:
sending a resource request message to the AR resource platform;
and receiving an allocation result obtained by the AR resource platform for allocating AR resources to the AR terminal according to the resource request message, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word and a challenge algorithm.
Optionally, when determining that the AR terminal is allowed to use AR resources, establishing a media channel connection with the AR terminal, including:
performing authentication with the AR resource platform;
after the authentication passes, determining that the AR resource is allowed to be used;
and establishing media channel connection with the AR resource platform when the AR resource is determined to be allowed to be used.
Optionally, the interaction with the AR resource platform performs authentication, including:
calculating to obtain a first token according to the challenge word and the challenge algorithm sent by the AR resource platform and the key of the AR terminal;
sending an authentication request to the AR resource platform, wherein the authentication request carries terminal information of an AR terminal and a first token;
and after receiving the terminal information and the token authentication pass by the AR resource platform, the feedback authentication passes the response.
Optionally, establishing a media channel connection with the AR resource platform includes:
sending a media channel connection request to the AR resource platform;
receiving an asynchronous event message fed back to the AR terminal after the AR resource platform initializes the AR resources and establishes a media channel connection port according to the media channel connection request;
And sending a response message of the asynchronous event message to the AR resource platform, and establishing media channel connection with the AR resource platform.
Optionally, the data transmission is performed through the media channel connection, including:
data sent to the AR resource platform through the media channel connection;
and receiving a processing result fed back by the AR resource platform according to the processing of the data by the asynchronous event message.
Note that, the device is a method on the AR terminal side corresponding to the method on the AR resource platform side shown in fig. 1, and all the implementation manners in the above method embodiments are applicable to the method on the AR terminal side, so that the same technical effects can be achieved.
The embodiment of the invention also provides an information interaction device which is applied to the augmented reality AR terminal, and the device comprises:
the receiving and transmitting module is used for establishing session connection with the augmented reality AR resource platform through the universal interface;
the processing module is used for obtaining the allocation of AR resources for the AR terminal through the session connection;
the receiving and transmitting module is also used for establishing media channel connection with the AR resource platform when determining that the AR resource is allowed to be used; and carrying out data transmission with the AR resource platform through the media channel connection.
Optionally, establishing session connection with the AR resource platform includes:
sending a session connection establishment request to the AR resource platform;
and receiving a session connection establishment response fed back by the AR resource platform, wherein the session connection establishment response carries information for agreeing to establish the session connection and a session identifier.
Optionally, through the session connection, allocating AR resources to the AR terminal includes:
sending a resource request message to the AR resource platform;
and receiving an allocation result obtained by the AR resource platform for allocating AR resources to the AR terminal according to the resource request message, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word and a challenge algorithm.
Optionally, when determining that the AR terminal is allowed to use AR resources, establishing a media channel connection with the AR terminal, including:
performing authentication with the AR resource platform;
after the authentication passes, determining that the AR resource is allowed to be used;
and establishing media channel connection with the AR resource platform when the AR resource is determined to be allowed to be used.
Optionally, the interaction with the AR resource platform performs authentication, including:
calculating to obtain a first token according to the challenge word and the challenge algorithm sent by the AR resource platform and the key of the AR terminal;
Sending an authentication request to the AR resource platform, wherein the authentication request carries terminal information of an AR terminal and a first token;
and after receiving the terminal information and the token authentication pass by the AR resource platform, the feedback authentication passes the response.
Optionally, establishing a media channel connection with the AR resource platform includes:
sending a media channel connection request to the AR resource platform;
receiving an asynchronous event message fed back to the AR terminal after the AR resource platform initializes the AR resources and establishes a media channel connection port according to the media channel connection request;
and sending a response message of the asynchronous event message to the AR resource platform, and establishing media channel connection with the AR resource platform.
Optionally, the data transmission is performed through the media channel connection, including:
data sent to the AR resource platform through the media channel connection;
and receiving a processing result fed back by the AR resource platform according to the processing of the data by the asynchronous event message.
It should be noted that, the apparatus is an apparatus corresponding to the method shown in fig. 7, and all implementation manners in the method embodiment described above are applicable to the apparatus embodiment, so that the same technical effects can be achieved.
The embodiment of the invention also provides an augmented reality AR terminal, which comprises: an information interaction device as described above.
The embodiment of the invention also provides an information interaction method, which comprises the following steps:
the AR resource platform establishes session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
the AR resource platform distributes AR resources for the AR terminal through the session connection;
when the AR resource platform determines that the AR terminal is allowed to use AR resources, media channel connection is established with the AR terminal;
and the AR resource platform is connected with the AR terminal through the media channel and performs data transmission with the AR terminal.
All the implementation manners in the method embodiment are applicable to the embodiment, and the same technical effect can be achieved.
The embodiment of the invention also provides an information interaction system, which comprises: the AR resource platform;
the AR resource platform interacts with an augmented reality AR terminal and establishes session connection with the AR terminal;
the AR resource platform interacts with the AR terminal through the session connection, and AR resources are distributed to the AR terminal;
when the AR resource platform determines that the AR terminal is allowed to use AR resources, media channel connection is established with the AR terminal;
And the AR resource platform is connected with the AR terminal through the media channel and performs data transmission with the AR terminal.
It should be noted that all the implementation manners of the AR terminal and the AR resource platform are applicable to the embodiment of the system, and the same technical effects can be achieved.
The embodiment of the invention also provides a processing device, which comprises: a processor, a memory storing a computer program which, when executed by the processor, performs the method as described above. All the implementation manners in the method embodiment are applicable to the embodiment, and the same technical effect can be achieved.
Embodiments of the present invention also provide a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform a method as described above. All the implementation manners in the method embodiment are applicable to the embodiment, and the same technical effect can be achieved.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.
In the embodiments provided in the present invention, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, etc.
Furthermore, it should be noted that in the apparatus and method of the present invention, it is apparent that the components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered as equivalent aspects of the present invention. Also, the steps of performing the series of processes described above may naturally be performed in chronological order in the order of description, but are not necessarily performed in chronological order, and some steps may be performed in parallel or independently of each other. It will be appreciated by those of ordinary skill in the art that all or any of the steps or components of the methods and apparatus of the present invention may be implemented in hardware, firmware, software, or a combination thereof in any computing device (including processors, storage media, etc.) or network of computing devices, as would be apparent to one of ordinary skill in the art after reading this description of the invention.
The object of the invention can thus also be achieved by running a program or a set of programs on any computing device. The computing device may be a well-known general purpose device. The object of the invention can thus also be achieved by merely providing a program product containing program code for implementing said method or apparatus. That is, such a program product also constitutes the present invention, and a storage medium storing such a program product also constitutes the present invention. It is apparent that the storage medium may be any known storage medium or any storage medium developed in the future. It should also be noted that in the apparatus and method of the present invention, it is apparent that the components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered as equivalent aspects of the present invention. The steps of executing the series of processes may naturally be executed in chronological order in the order described, but are not necessarily executed in chronological order. Some steps may be performed in parallel or independently of each other.
While the foregoing is directed to the preferred embodiments of the present invention, it will be appreciated by those skilled in the art that various modifications and adaptations can be made without departing from the principles of the present invention, and such modifications and adaptations are intended to be comprehended within the scope of the present invention.
Claims (22)
1. An information interaction method, which is characterized by being applied to an augmented reality AR resource platform, comprising:
establishing session connection with an augmented reality AR terminal supporting the universal interface through the universal interface;
through the session connection, AR resources are allocated to the AR terminal;
when determining that the AR terminal is allowed to use AR resources, establishing media channel connection with the AR terminal;
and carrying out data transmission with the AR terminal through the media channel connection.
2. The information interaction method according to claim 1, wherein establishing a session connection with an augmented reality AR terminal comprises:
receiving a session connection establishment request sent by the AR terminal;
and feeding back a session connection establishment response message to the AR terminal according to the session connection establishment request, wherein the session connection establishment response message carries information for agreeing to establish session connection and a session identifier.
3. The information interaction method according to claim 1, wherein allocating AR resources to the AR terminal through the session connection comprises:
receiving a resource request message sent by the AR terminal;
according to the resource request message, AR resources are allocated to the AR terminal, and an allocation result is sent to the AR terminal, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word and a challenge algorithm.
4. The information interaction method according to claim 1, wherein establishing a media channel connection with the AR terminal when determining that the AR terminal is allowed to use AR resources comprises:
authentication is carried out on the AR terminal;
after passing the authentication, determining that the AR terminal is allowed to use AR resources;
and establishing media channel connection with the AR terminal when determining that the AR terminal is allowed to use the AR resources.
5. The information interaction method according to claim 4, wherein authenticating the AR terminal comprises:
receiving an authentication request sent by the AR terminal, wherein the authentication request carries terminal information of the AR terminal and a first token, and the first token is obtained by calculating an AR terminal according to a challenge word and a challenge algorithm sent by the AR resource platform and a key of the AR terminal;
calculating to obtain a second token according to the challenge word and the challenge algorithm and the secret key;
and if the second token is the same as the first token, feeding back an authentication passing response to the AR terminal.
6. The information interaction method according to claim 5, wherein establishing a media channel connection with the AR terminal comprises:
Receiving a media channel connection request sent by the AR terminal;
according to the media channel connection request, AR resource initialization and media channel connection port establishment are carried out, and asynchronous event information is fed back to the AR terminal;
and after receiving the response message of the asynchronous event message sent by the AR terminal, establishing media channel connection with the AR terminal.
7. The information interaction method according to claim 6, wherein the data transmission with the AR terminal through the media channel connection includes:
receiving data sent by the AR terminal through the media channel connection;
processing the data according to the asynchronous event message to obtain a processing result;
and feeding back the processing result to the AR terminal through the media channel connection.
8. An information interaction method, which is applied to an augmented reality AR terminal supporting a universal interface, the method comprising:
establishing session connection with an augmented reality AR resource platform through a universal interface;
through the session connection, AR resources are allocated to the AR terminal;
when determining that AR resources are allowed to be used, establishing media channel connection with the AR resource platform;
And carrying out data transmission with the AR resource platform through the media channel connection.
9. The method of information interaction of claim 8, wherein establishing a session connection with an augmented reality AR resource platform comprises:
sending a session connection establishment request to the AR resource platform;
and receiving a session connection establishment response fed back by the AR resource platform, wherein the session connection establishment response carries information for agreeing to establish the session connection and a session identifier.
10. The information interaction method according to claim 8, wherein allocating AR resources to the AR terminal through the session connection comprises:
sending a resource request message to the AR resource platform;
and receiving an allocation result obtained by the AR resource platform for allocating AR resources to the AR terminal according to the resource request message, wherein the allocation result comprises a session identifier, a resource identifier of the AR resources allocated to the AR terminal, a challenge word and a challenge algorithm.
11. The information interaction method according to claim 8, wherein establishing a media channel connection with the AR terminal when determining that the AR terminal is allowed to use AR resources comprises:
performing authentication with the AR resource platform;
After the authentication passes, determining that the AR resource is allowed to be used;
and establishing media channel connection with the AR resource platform when the AR resource is determined to be allowed to be used.
12. The information interaction method according to claim 11, wherein the interaction with the AR resource platform for authentication, comprises:
calculating to obtain a first token according to the challenge word and the challenge algorithm sent by the AR resource platform and the key of the AR terminal;
sending an authentication request to the AR resource platform, wherein the authentication request carries terminal information of an AR terminal and a first token;
and after receiving the terminal information and the token authentication pass by the AR resource platform, the feedback authentication passes the response.
13. The method of information interaction of claim 8, wherein establishing a media channel connection with the AR resource platform comprises:
sending a media channel connection request to the AR resource platform;
receiving an asynchronous event message fed back to the AR terminal after the AR resource platform initializes the AR resources and establishes a media channel connection port according to the media channel connection request;
and sending a response message of the asynchronous event message to the AR resource platform, and establishing media channel connection with the AR resource platform.
14. The information interaction method of claim 13, wherein the data transmission through the media channel connection comprises:
data sent to the AR resource platform through the media channel connection;
and receiving a processing result fed back by the AR resource platform according to the processing of the data by the asynchronous event message.
15. An information interaction method, comprising:
the method comprises the steps that an augmented reality AR resource platform establishes session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
the augmented reality AR resource platform distributes AR resources for the augmented reality AR terminal through the session connection;
when the augmented reality AR resource platform determines that the AR resource is allowed to be used by the augmented reality AR terminal, establishing media channel connection with the augmented reality AR terminal;
and the augmented reality AR resource platform is connected with the media channel and performs data transmission with the augmented reality AR terminal.
16. An information interaction device, characterized by being applied to an augmented reality AR resource platform, the device comprising:
the receiving and transmitting module is used for establishing session connection with an augmented reality AR terminal supporting the universal interface through the universal interface;
The processing module is used for distributing AR resources to the AR terminal through the session connection;
the receiving-transmitting module is further used for establishing media channel connection with the AR terminal when determining that the AR terminal is allowed to use AR resources; and carrying out data transmission with the AR terminal through the media channel connection.
17. An augmented reality AR resource platform comprising the information interaction device of claim 16.
18. An information interaction apparatus, applied to an augmented reality AR terminal supporting a universal interface, the apparatus comprising:
the receiving and transmitting module is used for establishing session connection with the augmented reality AR resource platform through the universal interface;
the processing module is used for obtaining the allocation of AR resources for the AR terminal through the session connection;
the receiving and transmitting module is also used for establishing media channel connection with the AR resource platform when determining that the AR resource is allowed to be used; and carrying out data transmission with the AR resource platform through the media channel connection.
19. An augmented reality AR terminal, comprising: the information interaction device of claim 18.
20. An information interaction system, comprising: an augmented reality AR resource platform;
The augmented reality AR resource platform establishes session connection with an augmented reality AR terminal supporting a universal interface through the universal interface;
the augmented reality AR resource platform distributes AR resources for the augmented reality AR terminal through the session connection;
when the augmented reality AR resource platform determines that the AR resource is allowed to be used by the augmented reality AR terminal, establishing media channel connection with the augmented reality AR terminal;
and the AR resource platform is connected with the AR terminal through the media channel and performs data transmission with the AR terminal.
21. A processing apparatus, comprising: a processor, a memory storing a computer program which, when run by the processor, performs the method of any one of claims 1 to 7 or the method of any one of claims 8 to 14 or the method of claim 15.
22. A computer readable storage medium storing instructions which, when executed on a computer, cause the computer to perform the method of any one of claims 1 to 7 or the method of any one of claims 8 to 14 or the method of claim 15.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110521431.2A CN115426335B (en) | 2021-05-13 | 2021-05-13 | Information interaction method, device, equipment and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110521431.2A CN115426335B (en) | 2021-05-13 | 2021-05-13 | Information interaction method, device, equipment and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115426335A CN115426335A (en) | 2022-12-02 |
| CN115426335B true CN115426335B (en) | 2023-10-27 |
Family
ID=84195469
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110521431.2A Active CN115426335B (en) | 2021-05-13 | 2021-05-13 | Information interaction method, device, equipment and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115426335B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1809037A (en) * | 2005-01-19 | 2006-07-26 | 华为技术有限公司 | Method of implementing end-to-end information interaction |
| CN101273607A (en) * | 2005-08-26 | 2008-09-24 | 松下电器产业株式会社 | Establishment of media sessions with media adaptation |
| CN102082960A (en) * | 2010-10-29 | 2011-06-01 | 广东星海数字家庭产业技术研究院有限公司 | Interactive value added business platform system and method for digital television |
| CN102136933A (en) * | 2010-09-30 | 2011-07-27 | 华为技术有限公司 | Equipment management method, middleware and machine communication platform, equipment and system |
| CN105809591A (en) * | 2015-02-26 | 2016-07-27 | 上海三泽信息技术有限公司 | Method for realizing computer-aided teaching via virtual reality and software research and development technologies |
| CN112214338A (en) * | 2020-11-05 | 2021-01-12 | 北京科东电力控制***有限责任公司 | Internet of things cloud platform based on flexible deployment of micro-services |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20200259763A1 (en) * | 2020-04-27 | 2020-08-13 | Intel Corporation | Intelligent resource selection for received content |
-
2021
- 2021-05-13 CN CN202110521431.2A patent/CN115426335B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1809037A (en) * | 2005-01-19 | 2006-07-26 | 华为技术有限公司 | Method of implementing end-to-end information interaction |
| CN101273607A (en) * | 2005-08-26 | 2008-09-24 | 松下电器产业株式会社 | Establishment of media sessions with media adaptation |
| CN102136933A (en) * | 2010-09-30 | 2011-07-27 | 华为技术有限公司 | Equipment management method, middleware and machine communication platform, equipment and system |
| CN102082960A (en) * | 2010-10-29 | 2011-06-01 | 广东星海数字家庭产业技术研究院有限公司 | Interactive value added business platform system and method for digital television |
| CN105809591A (en) * | 2015-02-26 | 2016-07-27 | 上海三泽信息技术有限公司 | Method for realizing computer-aided teaching via virtual reality and software research and development technologies |
| CN112214338A (en) * | 2020-11-05 | 2021-01-12 | 北京科东电力控制***有限责任公司 | Internet of things cloud platform based on flexible deployment of micro-services |
Non-Patent Citations (1)
| Title |
|---|
| "增强现实虚实交互技术的研究与实现";李腾飞;《中国优秀硕士学位论文全文数据库 (基础科学辑)》;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115426335A (en) | 2022-12-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10924783B2 (en) | Video coding method, system and server | |
| US10194180B2 (en) | Systems and methods for transmitting video data over a network | |
| CN112738140B (en) | Video stream transmission method, device, storage medium and equipment based on WebRTC | |
| CN110213652B (en) | Audio and video data transmission method and device and storage medium | |
| CN110995777B (en) | Service management method and device | |
| CN113489805B (en) | Butt joint method, device, equipment and storage medium of cloud desktop system | |
| CN109889521B (en) | Memory, communication channel multiplexing implementation method, device and equipment | |
| CN109862438B (en) | Method and equipment for proxy forwarding of real-time streaming protocol streaming media data | |
| CN109996219B (en) | Internet of things authentication method, network equipment and terminal | |
| WO2013127163A1 (en) | Call terminal enrollment method and device | |
| US9832198B2 (en) | Service-based message access layer frame and implementation method thereof | |
| CN112968919B (en) | Data processing method, device, equipment and storage medium | |
| WO2016155495A1 (en) | Data exchange method, apparatus and device | |
| CN110798651A (en) | Video conference method, device, equipment and storage medium | |
| CN115426335B (en) | Information interaction method, device, equipment and system | |
| CN116521634B (en) | Method, system, electronic equipment and storage medium for processing call ticket data service | |
| CN112565236A (en) | Information authentication method, device, computer equipment and storage medium | |
| JP4593943B2 (en) | Method and system for delayed allocation of resources | |
| US9071596B2 (en) | Securely establishing a communication channel between a switch and a network-based application using a unique identifier for the network-based application | |
| CN115022074A (en) | User authentication and authorization method, device, medium and equipment | |
| CN110636114B (en) | Customer service access method, access system, service system and cloud platform | |
| WO2014015795A1 (en) | Method and device for providing communication connection for multiple candidate applications in mobile device | |
| CN114760602A (en) | Holographic communication method, device, system and computer readable storage medium | |
| CN114827307A (en) | Data sharing method, system and server based on multiple data systems | |
| CN108696510B (en) | Cloud-based multi-channel collaborative two-dimensional code production method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |