CN112243016A - Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method - Google Patents

Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method Download PDF

Info

Publication number
CN112243016A
CN112243016A CN201910649655.4A CN201910649655A CN112243016A CN 112243016 A CN112243016 A CN 112243016A CN 201910649655 A CN201910649655 A CN 201910649655A CN 112243016 A CN112243016 A CN 112243016A
Authority
CN
China
Prior art keywords
service
module
processed
applet
management service
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910649655.4A
Other languages
Chinese (zh)
Other versions
CN112243016B (en
Inventor
刘玮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Senge Huanrui Intelligent Technology Co ltd
Original Assignee
Beijing Senge Huanrui Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Senge Huanrui Intelligent Technology Co ltd filed Critical Beijing Senge Huanrui Intelligent Technology Co ltd
Priority to CN201910649655.4A priority Critical patent/CN112243016B/en
Publication of CN112243016A publication Critical patent/CN112243016A/en
Application granted granted Critical
Publication of CN112243016B publication Critical patent/CN112243016B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/51Discovery or management thereof, e.g. service location protocol [SLP] or web services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/56Provisioning of proxy services

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The embodiment of the invention provides a middleware platform, terminal equipment, a 5G artificial intelligence cloud processing system and a processing method, wherein the middleware platform is arranged on a SaaS platform and comprises: a cloud service engine; an Application Programming Interface (API) service layer and a plurality of management service modules are arranged in the cloud service engine; the API service layer is connected with the hosting service of the SaaS platform; the management service module is connected with an Applet module of the terminal equipment through a communication network; in the embodiment of the invention, the terminal equipment sends the service to be processed to the middleware platform through the Applet module, and the management service module in the cloud service engine of the middleware platform determines the hosting service corresponding to the service to be processed and sends the service to be processed to the hosting service for processing, so that the intelligent function of the terminal equipment is moved to the cloud platform for processing, the influence on the performance of the terminal equipment is reduced, various intelligent functions can be simultaneously supported, and the multi-mode intelligent function requirement of the terminal equipment is met.

Description

Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to a middleware platform, terminal equipment, a 5G artificial intelligence cloud processing system and a processing method.
Background
Third generation communication technology (3)rdgeneration, 3G) mobile network, primarily for providing voice and data services, and simple reason-based access to mobile web pagesConnecting an extra network; fourth generation communication technology (4th generation, 4G), Long Term Evolution (LTE) mobile networks, and publicly accessible Wireless Fidelity (WiFi) networks make it possible to create richer content and more intelligent functions in local mobile applications (apps). Currently, a fifth generation communication technology (5th generation, 5G) mobile network is being deployed, which will integrate high-speed voice, video, streaming media and big data functions on the terminal device, with the same performance as a high-performance desktop running on a high-speed local area network.
Single modality intelligence capabilities such as computer vision (i.e. optical recognition of objects visible in the field of view by the camera of the terminal device), artificial intelligence that can handle objects seen, differences between different data forms, natural language based technology, and speech synthesis in conversations, including content parsing and high performance requirements for data, can provide the user with customized configuration content. Other single-modality functions are also emerging, such as: machine learning, chat robots, data analysis, advanced geographic location, etc. However, when these new single-mode intelligent functions are designed into the App of the terminal device, the terminal device is required to process corresponding content and data, which will affect the performance of the terminal device in terms of storage, battery life, and the like.
Therefore, a scheme capable of avoiding affecting the performance of the terminal device while meeting the requirement of the multi-modal intelligent function of the terminal device is needed urgently.
Disclosure of Invention
The embodiment of the invention provides a middleware platform, terminal equipment, a 5G artificial intelligence cloud processing system and a processing method, and solves the multi-mode intelligent function requirement of the terminal equipment.
According to a first aspect of embodiments of the present invention, there is provided a middleware platform disposed in a software as a service, SaaS, platform, the middleware platform including: a cloud service engine;
an Application Programming Interface (API) service layer and a plurality of management service modules are arranged in the cloud service engine;
the API service layer is connected with the hosting service of the SaaS platform;
the management service module is connected with an Applet module of the terminal equipment through a communication network;
the management service module is used for receiving the service to be processed from the Applet module;
the management service module is also used for determining corresponding managed service according to the service to be processed;
the API service layer is used for sending the service to be processed to the corresponding managed service;
the API service layer is also used for receiving the processed business from the corresponding managed service and sending the processed business to the management service modules;
and the management service module is also used for sending the processed service to the Applet module.
Optionally, the management service module comprises at least one of:
the system comprises a content management service module, an API management service module, a device management service module, a service management service module, an Applet management service module and a logic management service module.
Optionally, the hosted service includes at least one of:
artificial intelligence/machine learning services, image services, natural language services, analytics services, database storage services, computing services, data services, device management services, business services.
Optionally, the content management service module includes:
a logic editing tool;
a plurality of databases;
a network partition for storing schemas and files for the plurality of databases;
the plurality of databases comprises at least one of:
the system comprises a metadata database, a first API database, a device database, a first service database, an App database, a content database, a first rule database, a summary database, a first heuristic database, a first network database and a logic database.
Optionally, the API management service module includes:
a logic editing tool;
a plurality of databases;
a network partition for storing schemas and files for the plurality of databases;
the plurality of databases comprises at least one of:
the system comprises a first instance database, a registry database, a protocol database, a key database, a first micro-service database, a second micro-service database and a second API database.
Optionally, the device management service module includes:
a logic editing tool;
a plurality of databases;
a network partition for storing schemas and files for the plurality of databases;
the plurality of databases comprises at least one of:
file handle database, equipment input/output database, update database, software/hardware configuration identification database, warning database, second rule database, audit log database, second heuristic database, license database, second network database, security certification authorization database, and equipment instance database.
Optionally, the service management service module includes:
a logic editing tool;
a plurality of databases;
a network partition for storing schemas and files for the plurality of databases;
the plurality of databases comprises at least one of:
a second instance database, a configuration database, a third rule database, a third API database, a second service database, a third service database, and a fourth service database.
Optionally, the Applet management service module includes:
an Applet manager, an Applet compiler, a container engine, and an Applet database.
Optionally, the logic management service module includes:
a logic editing tool;
a content management service database, an API management service database, an equipment management service database, a service management service database, and an Applet management service database.
Optionally, when the service to be processed is an image service, the corresponding hosting service is the image service;
the content management service module is used for receiving the image to be processed from the Applet module;
the content management service module is further configured to match the image to be processed with the content database, and determine a processing request matched with the image to be processed;
the API service layer is also used for sending the image to be processed and the processing request to the image service, and the image service determines a display image according to the image to be processed and the processing request;
the API service layer is also used for receiving the display image from the image service and sending the display image to the content management service module;
and the content management service module is also used for sending the display image to the Applet module.
Optionally, when the service to be processed is a voice service, the corresponding hosted service is the natural language service;
the content management service module is used for receiving the voice to be processed from the Applet module;
the content management service module is further configured to match the to-be-processed voice with the content database, and determine a processing request matched with the to-be-processed image;
the API service layer is also used for sending the voice to be processed and the processing request to the natural language service, and the natural language service determines voice content information according to the voice to be processed and the processing request;
the API service layer is also used for receiving the voice content information from the natural language service and sending the voice content information to the content management service module;
and the content management service module is also used for sending the voice content information to the Applet module.
Optionally, when the to-be-processed service is a geographic location service, the corresponding hosted service is the analysis service;
the content management service module is used for receiving the geographic position data of the terminal equipment from the Applet module;
the content management service module is further configured to match the geographic position data with the content database, and determine a processing request matched with the geographic position data;
the API service layer is also used for sending the geographic position data and the processing request to the analysis service, and the analysis service determines a geographic position data analysis result according to the geographic position data and the processing request;
the API service layer is also used for receiving the geographic position data analysis result from the analysis service and sending the geographic position data analysis result to the content management service module;
and the content management service module is also used for sending the geographic position data analysis result to the Applet module.
According to a second aspect of the embodiments of the present invention, there is provided a terminal device, including an input/output module and a device component, where the device component includes an operating system, a native App is set in the operating system, an Applet module is set in the native App, and the Applet module is connected to a plurality of management service modules in a middleware platform through a communication network;
the Applet module is used for sending a service to be processed to the management service module, and the management service module processes the service to be processed;
and the Applet module is also used for receiving the processed business from the management service module.
Optionally, the native App comprises:
the intelligent function module, the embedded function module, the information function module and the dialogue function module;
the intelligent function module is connected with the Applet module.
Optionally, the Applet module includes:
the device comprises a cache unit, a local database, a device input/output function unit, an Applet logic unit and an Applet data unit.
Optionally, when the service to be processed is an image service,
the Applet module is used for sending an image to be processed to a content management service module in the management service module;
the Applet module is also used for receiving display images from the content management service module.
Optionally, when the pending service is a voice service,
the Applet module is used for sending the voice to be processed to a content management service module in the management service module;
and the Applet module is also used for receiving the voice content information from the content management service module.
Optionally, when the pending service is a geographical location service,
the Applet module is used for sending geographic position data to a content management service module in the management service module;
and the Applet module is also used for receiving a geographic position data analysis result from the content management service module.
Optionally, the smart function module is configured to receive the processed service from the Applet module;
the intelligent function module is also used for determining information to be displayed according to the processed service;
and the embedded functional module is used for embedding the information to be displayed into the current display interface of the terminal equipment.
Optionally, the terminal device further includes: the starting module stores at least one preset condition inside;
and the starting module is used for starting the Applet module when the information received by the input/output module meets the preset condition.
Optionally, the preset condition is determined by preset preference information and/or historical statistical information.
According to a third aspect of the embodiments of the present invention, there is provided a 5G artificial intelligence cloud processing system, including a SaaS platform, where the SaaS platform includes a hosting service, including: the 5G artificial intelligence cloud processing system further comprises: the middleware platform according to the first aspect and the terminal device according to the second aspect are provided on a SaaS platform, and the middleware platform is connected to the terminal device through a communication network.
According to a fourth aspect of the embodiments of the present invention, there is provided a processing method applied to the middleware platform according to the first aspect, the method including:
the management service module receives a service to be processed from an Applet module of the terminal equipment;
the management service module determines corresponding managed service according to the service to be processed;
the API service layer sends the service to be processed to the corresponding managed service;
the API service layer receives the processed business from the corresponding managed service and sends the processed business to the management service module;
and the management service module sends the processed service to the Applet module.
Optionally, when the service to be processed is an image service, the corresponding hosting service is an image service;
the management service module receives the service to be processed from an Applet module of the terminal equipment, and the method comprises the following steps:
the content management service module receives an image to be processed from the Applet module;
the management service module determines a corresponding managed service according to the service to be processed, and the method comprises the following steps:
the content management service module matches the image to be processed with the content database and determines a processing request matched with the image to be processed;
the API service layer sends the service to be processed to the corresponding managed service, and the method comprises the following steps:
the API service layer sends the image to be processed and the processing request to the image service, and the image service determines a display image according to the image to be processed and the processing request;
the API service layer receives the processed service from the corresponding managed service, and sends the processed service to the management service module, including:
the API service layer receives the display image from the image service and sends the display image to the content management service module;
the plurality of management service modules send the processed service to the Applet module, and the method comprises the following steps:
and the content management service module sends the display image to the Applet module.
Optionally, when the service to be processed is a voice service, the corresponding hosted service is a natural language service;
the management service module receives the service to be processed from an Applet module of the terminal equipment, and the method comprises the following steps:
the content management service module receives the voice to be processed from the Applet module;
the management service module determines a corresponding managed service according to the service to be processed, and the method comprises the following steps:
the content management service module matches the voice to be processed with the content database and determines a processing request matched with the voice to be processed;
the API service layer sends the service to be processed to the corresponding managed service, and the method comprises the following steps:
the API service layer sends the voice to be processed and the processing request to the natural language service, and the natural language service determines voice content information according to the voice to be processed and the processing request;
the API service layer receives the processed service from the corresponding managed service, and sends the processed service to the management service module, including:
the API service layer receives the voice content information from the natural language service and sends the voice content information to the content management service module;
the plurality of management service modules send the processed service to the Applet module, and the method comprises the following steps:
and the content management service module sends the voice content information to the Applet module.
Optionally, when the to-be-processed service is a geographic location service, the corresponding hosted service is an analysis service;
the management service module receives the service to be processed from an Applet module of the terminal equipment, and the method comprises the following steps:
the content management service module receives the geographic position data of the terminal equipment from the Applet module;
the management service module determines a corresponding managed service according to the service to be processed, and the method comprises the following steps:
the content management service module matches the geographic position data with the content database and determines a processing request matched with the geographic position data;
the API service layer sends the service to be processed to the corresponding managed service, and the method comprises the following steps:
the API service layer sends the geographic position data and the processing request to the analysis service, and the analysis service determines a geographic position data analysis result according to the geographic position data and the processing request;
the API service layer receives the processed service from the corresponding managed service, and sends the processed service to the management service module, including:
the API service layer receives the geographic position data analysis result from the analysis service and sends the geographic position data analysis result to the content management service module;
the plurality of management service modules send the processed service to the Applet module, and the method comprises the following steps:
and the content management service module sends the geographic position data analysis result to the Applet module.
According to a fifth aspect of the embodiments of the present invention, there is provided a processing method applied to the terminal device according to the second aspect, the method including:
the method comprises the steps that an Applet module sends a service to be processed to a management service module of a middleware platform, and the management service module processes the service to be processed;
and the Applet module receives the processed business from the management service module.
Optionally, when the service to be processed is an image service,
the Applet module sends the service to be processed to a management service module of the middleware platform, and the method comprises the following steps:
the Applet module sends an image to be processed to a content management service module in the management service module;
correspondingly, the Applet module receives the processed service from the management service module, and the processing includes:
the Applet module receives a display image from the content management service module.
Optionally, when the pending service is a voice service,
the Applet module sends the service to be processed to a management service module of the middleware platform, and the method comprises the following steps:
the Applet module sends the voice to be processed to a content management service module in the management service module;
correspondingly, the Applet module receives the processed service from the management service module, and the processing includes:
the Applet module receives voice content information from the content management service module.
Optionally, when the pending service is a geographical location service,
the Applet module sends the service to be processed to a management service module of the middleware platform, and the method comprises the following steps:
the Applet module sends geographic position data to a content management service module in the management service module;
correspondingly, the Applet module receives the processed service from the management service module, and the processing includes:
and the Applet module receives the geographic position data analysis result from the content management service module.
Optionally, the method further comprises:
the intelligent function module receives the processed service from the Applet module;
the intelligent function module determines information to be displayed according to the processed service;
and the embedded functional module embeds the information to be displayed into a current display interface of the terminal equipment.
Optionally, before the Applet module sends the service to be processed to the management service module of the middleware platform, the method further includes:
the starting module judges that the information received by the input/output module meets a preset condition;
and when the received information meets a preset condition, starting the Applet module.
Optionally, the preset condition is determined by preset preference information and/or historical statistical information.
In the embodiment of the invention, the terminal equipment sends the service to be processed to the middleware platform through the Applet module, and the management service module in the cloud service engine of the middleware platform determines the hosting service corresponding to the service to be processed and sends the service to be processed to the hosting service for processing, so that the intelligent function of the terminal equipment is moved to the cloud platform for processing, the influence on the performance of the terminal equipment is reduced, various intelligent functions can be simultaneously supported, and the multi-mode intelligent function requirement of the terminal equipment is met.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
Fig. 1 is one of schematic structural diagrams of a 5G artificial intelligence cloud processing system according to an embodiment of the present invention;
fig. 2 is a second schematic structural diagram of a 5G artificial intelligence cloud processing system according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a content management service module according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of an API management service module according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a device management service module according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a service management service module according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of an Applet management service module according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a logic management service module according to an embodiment of the present invention;
fig. 9 is a schematic structural diagram of a terminal device according to an embodiment of the present invention;
fig. 10 is a second schematic structural diagram of a terminal device according to an embodiment of the present invention;
FIG. 11 is a flowchart illustrating a processing method according to an embodiment of the present invention;
fig. 12 is a second flowchart of the processing method according to the embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, an embodiment of the present invention provides a 5G artificial intelligence cloud processing system 1, including a Software as a Service (SaaS) platform 11, where the SaaS platform 11 includes a hosted Service 12, and the 5G artificial intelligence cloud processing system 1 further includes a terminal device 20 and a middleware platform 30, where the middleware platform 30 is disposed on the SaaS platform 11, and the middleware platform 30 is connected to the terminal device 20 through a communication network.
The middleware platform 30 and the terminal device 20 can be connected in various ways;
fig. 1 shows that the middleware platform 30 is connected with the terminal device 20 through the mobile network 13, and specifically, the terminal device 20 sends and receives information to and from the mobile network 13 through the antenna 14 to realize communication with the middleware platform 30;
fig. 1 also shows the middleware platform 30 and the terminal device 20 through the WiFi network 15. Optionally, the WiFi network 15 interfaces with the internet of things sensors 16 through the antenna 14 to obtain communications, services and data.
Alternatively, a hosted Platform as a Service (PaaS) Platform 11a is provided in the SaaS Platform 11, and the PaaS Platform 11a is hosted by a third party or provided exclusively by a user.
The SaaS platform 11 includes a hosted service 12, the hosted service 12 can be divided into two categories, namely an intelligent service and a data service, and the middleware platform 30 interfaces with the hosted service 12 to realize interfacing with a third-party SaaS provider of the intelligent service and the data service.
The terminal device 20 is provided with an Applet (Applet) module 21, which Applet module 21 is provided in a native app (native app)22 of the terminal device 20.
The Applet may also be referred to as a Mobile Applet (Mobile Applet), and the native App may also be referred to as a native Mobile App (native Mobile Applet).
The middleware platform 30 interfaces with the Applet module 21.
The middleware platform 30 is installed in the SaaS platform 11 that a developer or a user can host, for example: a middleware platform 30 is installed on a PaaS platform 11a in the SaaS platform 11.
In an embodiment of the present invention, the middleware platform 30 includes: a cloud service engine 31, in which an Application Programming Interface (API) service layer 32 and a plurality of management service modules (not shown in the figure) are disposed in the cloud service engine 31. The API service layer 32 is connected to the hosted service 12 of the SaaS platform 11; the plurality of management service modules are connected to the Applet module 21 of the terminal device 20 through a communication network.
The terminal device 20 develops and stores content onto the cloud using a Web-based compiler and creation toolkit; storing content generated by developers on the cloud, and storing a large amount of content on a server based on different users and market segments;
the management service module of the middleware platform 30 stores user preference data associated with a plurality of end device users; based on the specific content preferences of the user of terminal device 20, digital content and services are selected and deployed to native App 22 in terminal device 20;
the selected content is transmitted to an internet protocol address associated with the terminal device 20 for receipt and display on the user's terminal device as a native function to be used.
Referring to fig. 2, fig. 2 is an architecture schematic of a 5G artificial intelligence cloud processing system 1 further detailed on the basis of fig. 1.
The plurality of management service modules in the cloud service engine 31 include at least one of:
a content management service module 33;
an API management service module 34;
a device management service module 35;
a service management service module 36;
an Applet management service module 37;
a logic management service module 38;
the hosted services 12 of the SaaS platform 11 include at least one of:
artificial Intelligence (AI)/Machine Learning (ML) service 111, image service 112, Natural Language (NLP) service 113, analytics service 114, database storage service 115, computing service 116, data service 117, device management service 118, commerce service 119.
In fig. 2, the hosted service 12 may be provided through a public cloud service, which may be obtained from an existing public cloud provider, and a private cloud scheme, and subscribe to a hierarchy-based function set through the internet. Hybrid clouds are a class of services that typically combine cloud functionality with platform/hardware type options to support the hybrid functionality, including cloud bursting or resilient computing services for network load balancing, rather than dedicated virtual or dedicated server environments. Private clouds are typically designed by specialized enterprises and managed by companies, but also typically contain the service functions described above.
In some embodiments, the middleware platform 30 performs system configuration through the cloud service engine 31, and utilizes at least one configured hosted service 12 (optionally one or more of items 111-119 in fig. 2), and presents these services through the API service layer 32 according to logical wizards, rules and standards formulated by management services (optionally one or more of items 33-38 in fig. 2) generally stored by a plurality of management service modules, and finally presents the services to the Applet module 21 in the terminal device 20 through the mobile network 13 or the WiFi network 15, and further to the native App 22, so as to provide its features, functions and intelligent type services for the native App 22.
In the system shown in fig. 2, multiple native apps 22 and multiple middleware platforms 30, in different PaaS platform 11a options, and in different SaaS platform 11 options, contain multiple horizontally oriented and vertically oriented use cases.
In addition, embodiments of the present invention provide multiple intelligent functions in some native apps 22, which can be implemented simply by configuring parameters of cloud services engine 31, including configuration in device management services module 35, configuration in service management services module 36, configuration in Applet management services module 37, and configuration in logic management services module 38.
In some embodiments, the API services layer 32 contains at least one API for loading, installing and running one or more APPs in the middleware platform 30, which isolates the middleware platform 30 components from the APP that calls it, and provides various other services for the APP.
The cloud service engine 31 has the following functions: (i) receive the device profile from the Applet module 21, and (ii) send metadata to the Applet management service module 37 that handshakes with the logic management service module 38, (iii) process the content profile immediately upon reading the content management database, and (iv) provide smart functions and related content to the Applet module 21 to cause the Applet module 21 to render in the form of native properties in the native App 22. The loop can be repeated in various terminal devices using the infrastructure and a plurality of functions can be created on a large scale.
The Applet module 21 is connected to the middleware platform 30 through a Web service. The Web services used by mobile client applications Access the server-side traffic types of the applications via hypertext Transfer Protocol (HTTP)/Simple Object Access Protocol (SOAP) for use in synchronous and asynchronous applications. The cloud service engine 31 provides business logic and intelligent functionality for Applet instances that are modular and presented in a containerized service.
The specific structure of the plurality of management service modules in the cloud service engine 31 is described below with reference to the drawings.
Referring to fig. 3, a specific structure of the content management service module 33 is shown. The content management service module 33 includes:
a logic editing tool 330;
a plurality of databases;
a network partition 332 for storing schemas (schemas) 3321 and files (files) 3322 of the plurality of databases;
the plurality of databases includes at least one of:
a metadata repository 3301 for storing metadata information compiled by the system;
a first API database 3302 for storing an API compiled by the third party service provider, an API compiled by the first service database 3304, an API created by the user, and an API compiled in the Applet management service module 37;
a device database 3303 for storing compiled device Profile (Profile) files, type, security, and configuration information;
a first service database 3304 for storing compiled service Resource locators (URLs), configurations, instances (instances), and scripts for instances compiled in the Applet management service module 37 and hosted by a third party;
an App database 3305 for storing the design, content association, functionality, features, configuration, instances, and scripts of a compiled App mapped to hosted instances compiled in the Applet management service module 37;
a content database 3306;
a first rule database 3307 for storing content or service rules compiled in the Applet management service module 37 and device-based rules compiled in the device management service module 35;
a summary database 3308 for storing summary-based rules compiled in the content management service module 33;
a first heuristic database 3309 for storing analytics or heuristic based triggers, rules, and data sources compiled in the device management service module 35 or in the Applet management service module 37;
a first network database 3310 for storing network configuration, authentication, protocol and service information compiled in the device management service module 35 or in the Applet management service module 37;
a logic database 3311 for storing custom network instance information compiled in the device management service module 35 or in the Applet management service module 37;
in an embodiment of the invention, all associated schemas 3321 and files 3322 for each database are partitioned using a dynamic database and storage architecture and stored in the network partition 332 using a third party storage cloud in the platform (e.g., database storage service 115 in hosting service 12).
The dynamic database structure uses a fully hosted real-time messaging service that allows messages to be sent and received between independent applications, where services, parameters, files, content, etc. can also be created, assembled, managed, and deployed using a simple consumable database structure. These structures are created and managed using the device management service module 35 or at the Applet management service module 37 and deployed as integrated Applet instances stored in the logical database 3311. Before any database operations are performed, an authenticated and secure connection between a mobile telecommunications network or a private wireless network is established by using the dedicated security measures of the device management service module 35. The query string may be used to insert, delete or look up information, or to wake up a large-scale service, through an established connection.
Referring to fig. 4, a specific structure of the API management service module 34 is shown. API management service module 34 is intended to create a published directory of application programming interfaces to facilitate reusability and discoverability of single and multiple instances across platforms. In this architecture, a composite application programming interface may be constructed by importing a logical APP as an interface from an interface or service provider (e.g., hosting service 12).
The API management service module 34 includes:
a logic editing tool 340;
a plurality of databases;
a network partition 342 for storing schemas 3421 and files 3422 of the plurality of databases;
the plurality of databases includes at least one of:
a first instance database 3401, a registry database 3402, a protocol database 3403, a key database 3404, a first micro-service database 3405, a second micro-service database 3406, and a second API database 3407.
In an embodiment of the present invention, the goal of the API management service module 34 is to separate the front-end client from the back-end, enabling developers to write and rewrite the first instance database 3401, the registry database 3402, the protocol database 3403, the key database 3404, translate requests to the first microservice database 3405 and the second microservice database 3406, and map them to different back-ends. It is also responsible for handling many Cross-domain issues such as authentication, Cross Origin Resource Sharing (CORS) support and response caching.
The API management service module 34 can facilitate service communication between the service provider and the cloud service engine 31, enabling automatic interconnection with the hosted service 12, the commercialized SaaS platform 11, and the Applet module 21 of the terminal device 20. All association schemas 3421 and files 3422 for each database are partitioned using dynamic database and storage schemas and stored in network partition 342 using a third party storage cloud in the platform (e.g., database storage service 115 in hosting service 12).
In one embodiment, the API instances saved to the database are stored as published lists of services available within the platform, and these provided connections may be used dynamically with artificial intelligence services, or differences may be used to provide the APIs. Or provide these APIs using terminal device differentiation and specific access to Applet instances and hosted in the cloud. This design makes it possible to automatically use the dynamic functions provided by the cloud service when market or user needs change.
Developers may also import existing Web Services by importing an Open API (Open API), which may also be referred to as an Open platform, through the Open API specification or importing an application programming interface that supports SOAP, Remote Procedure Call (RPC), and Representational State Transfer (REST), as well as Web Services Description Language (WSDL) specifications.
Referring to fig. 5, a specific structure of the device management service module 35 is shown. The device Management service module 35 may be designed using an Enterprise Mobile Management (EMM) architecture that includes a set of tools, techniques, procedures and policies for managing and maintaining the use of terminal devices, APPs, content and services within instances, so that users can securely store content, features, services and instances on the terminal devices 20 through the Applet module.
The device management service module 35 includes:
a logic editing tool 350;
a plurality of databases;
a network partition 352 for storing schemas 3521 and files 3522 of the plurality of databases;
the plurality of databases includes at least one of:
file handle database 3501, device input/output database 3502, update database 3503, software/hardware configuration identification database 3504, warning database 3506, second rules database 3507, audit log database 3508, second heuristic database 3509, license certificates database 3510, second network database 3511, security certification authority database 3512, device instance database 3513;
in embodiments of the present invention, the EMM architecture is capable of performing a series of policies, such as by interfacing with the native App 22 of the terminal device 20 to enable device input/output database 3502 access and update database updates (e.g., authentication updates), identifying the software/hardware configuration identification database 3504 (e.g., software/hardware configuration file information), providing an alert database 3506, a second rules database 3507, an audit log database 3508, a second heuristics database 3509. Encrypted server-side communication is employed between the Applet module 21 of the terminal device 20 and the cloud service engine 31 through secure HTTP to implement certificate management, authentication and revocation of the license certificate database 3510, and the second network database 3511 supports security policies of the security certificate authority database 3512 such as: terminal Device Management (MDM), office with its Own Device (BYOD). All association schemas 3521 and files 3522 partition each database using dynamic database and storage schemas and are stored in network partition 352 using the platform's third party storage cloud (e.g., database storage service 115 in hosting service 12).
The device policy is managed by receiving a policy list corresponding to the mobile design type from the configuration files of the software/hardware configuration identification database 3504, the device alert database 3506, the second rule database 3507, the audit log database 3508, and the second heuristic database 3509 by the device management service module 35, and storing the policy list in the device instance database 3513, for example: terminal device type, smartphone, tablet or smart glasses functionality, which also have different hardware configurations (display type, size, processor, operating system, storage, etc.).
When different versions of a product exist, the policy may "inherit" from other policies currently stored in the device instance database 3513, such as: the multiple profiles may be unified based on certain similar characteristics of the hardware profiles in the software/hardware configuration identification database 3504. The policy may specify the use and support of input/output by end device 20 (e.g., accelerometers, multiple cameras, or other elements defined by the developer).
Referring to fig. 6, a specific structure of the service management service module 36 is shown. The service management service module 36 includes:
a logic editing tool 360;
a plurality of databases;
a network partition 362 for storing schemas 3621 and files 3622 for the plurality of databases;
the plurality of databases includes at least one of:
a second instance database 3601, a configuration database 3602, a third rule database 3603, a third API database 3604, a second service database 3605, a third service database 3606, and a fourth service database 3607.
In the embodiment of the present invention, the service management service module 36 manages a plurality of cloud infrastructure services, namely the hosted service 12, under the middleware platform 30, and the service management service module 36 facilitates connecting, integrating and deploying these dedicated cloud services without cost and complexity. These cloud services include intelligent services such as: AI/ML service 111, image service 112 (e.g., image indexing, augmented reality, and computer vision), NLP service 113, and analytics service 114. Data services such as database storage services 115, computing services 116, data services 117, device management services 118 (e.g., MDM services), and commerce services 119 (such as mobile payment or mobile wallet functionality) are also provided through the cloud.
The schema, rules, and services are stored in the second instance database 3601, the configuration database 3602, the third rules database 3603, and the third API database 3604, respectively. Third party services from the hosted service 12 are stored in separate infinitely repeatable second and third service databases 3605, 3606. All association schema 3621 and each database file 3622 are partitioned using dynamic databases and storage schemas and stored in network partition 362 using a third party storage cloud in the platform (e.g., database storage service 115 in hosting service 12).
The service management service module 36 connects, integrates and manages a plurality of service functions according to the needs of developers, thereby constructing a service instance supporting a plurality of features, a plurality of functions and APPs. These services are connected to a service provider such as the PaaS platform 11a or the SaaS platform 11 using secure HTTP. The service management service module 36 also uses the third rule database 3603 to manage development and management automation workflows, triggers and alarms.
Referring to fig. 7, a specific structure of the Applet management service module 37 is shown. The Applet management service module 37 includes:
applet manager 371, Applet compiler 372, container engine 373, Applet database 374;
wherein, the Applet database 374 may be provided with a plurality of sets of binary file/class libraries (Bins/Libs) (reference numeral 3751 and 3754) and Applet instances (reference numeral 3755 and 3758), it can be understood that, in the Applet database 374 shown in fig. 9, 4 sets of binary file/class libraries and Applet instances are provided, the number of the sets may be other numbers, and this is not limited in the embodiment of the present invention.
In the embodiment of the present invention, the Applet management service module 37 functions as an application version control platform through the Applet manager 371, and at the same time, as an application builder, constructs, compiles and deploys the mobile APP and related instances (e.g., Applet 1 instance 1, Applet 2 instance 2, Applet 3 instance 3, and Applet 4 instance 4 in fig. 9) using the Applet compiler 372, and stores the Applet instances in the Applet database 374.
The key to the embodiments of the present invention is the container architecture, which includes a container engine 373, the container engine 373 providing specific deployments of apps and instances running in a virtual state using a container-supporting framework (e.g., Docker or Kubernetes). Another key to embodiments of the present invention is the use of a container engine (153) to coordinate computing, networking, and storage infrastructure and resources instead of a user's workload. This brings great simplicity and flexibility of the PaaS Infrastructure as a Service (IaaS), and provides portability across services and Infrastructure, facilitating the assembly of different modalities in a single solution deployed as an Applet module 21. This also enables us to use the functionality of binary files/class libraries, which typically provide logic and resources in a set of libraries and execute in a virtual environment by way of the Applet module 21 as an instance, providing intelligent functionality.
Many of the services managed by the Applet management service module 37 are presented as intelligent functions in the Applet module 21 to the user interface and bound to the services and deployed as application instances. For example, the Applet management service module 37 specifies an API specified by the developer, with a user interface specified in the Applet, to provide functionality in a virtualization layer that appears as embedded functionality in native mobile applications. Corresponding to the device profile, the Applet management service module 37 is configured to work with the service management service module 36 to provide, create and manage virtual or new container-based instances on-the-fly, providing enhanced computing services, service additions, heuristics or intelligence functionality for the client.
A key implementation of the method of communicating between all hosted services 12 and the Applet module 21. The Applet management service module 37 is designed for high availability and dynamically configures applications and instances with artificial intelligence services according to market, network, customer or content expansion. To achieve the interaction, the system uses a Session Initiation Protocol (SIP) based proxy service, a registration service, a rule service provided by the service management service module 36, a Session service, and an HTTP proxy service. For applications requiring high availability and/or low latency, a separate Quality of Service (QoS) may also be added to the platform.
Referring to fig. 8, a specific structure of the logic management service module 38 is shown. The logic management service module 38 includes:
a logic editing tool 380;
a content management service database 381, an API management service database 382, a device management service database 383, a service management service database 384, and an Applet management service database 385;
in the embodiment of the present invention, the logic management service module 38 mainly includes a service architecture capable of providing access to a large amount of compiled and stocked contents and services, and in particular, various libraries for the content management service module 33, the API management service module 34, the device management service module 35, the service management service module 36, and the Applet management service module 37. Each service provides resources for developers to present the service as an intelligent feature into native mobile APPs, functions, and other services through the use of the logic editing tool 380. All schemas, logic, rules, content and files are stored in separate databases, including a content management service database 381, an API management service database 382, a device management service database 383, a service management service database 384, an Applet management service database 385.
Referring to fig. 9, a specific structure of the terminal device 20 is shown, which includes an input/output module 23 and a device component 24, where the device component 24 includes an operating system 240, a native App 22 is provided in the operating system 240, an Applet module 21 is provided in the native App 22, and the Applet module 21 is connected to a plurality of management service modules in the middleware platform 30 through a communication network;
the native App 22 is an App that has been installed on a terminal device for loading, installation, and operation.
The input/output module 23 shown in fig. 9 includes: accelerometer 2301, power button 2302, keyboard 2303, display 2304, Subscriber Identity Module (SIM) card 2305, battery 2306, Universal Serial Bus (USB) interface 2307, speaker 2308, microphone 2309, camera 2310 (i.e., camera 1), and camera 2311 (i.e., camera 2).
The equipment assembly 24 shown in fig. 9 further comprises: a Central Processing Unit (CPU) 241, a Read Only Memory (ROM) 242, a Random Access Memory (RAM) 243, a Coder-DECOder (CODEC) 244, a digital signal/audio processor 245, an analog-to-digital/digital-to-analog converter 246, a radio frequency converter, and a power amplifier 247.
The terminal device 20 shown in fig. 9 further includes: a transmit/receive software stack 25, a bluetooth/GPS 26, an antenna 14.
The native App 22, Applet module 21 and device components 24 interface to provide unique functionality, including but not limited to: image capture using two cameras 2310 and 2311, audio capture using microphone 2309, CODEC 244, digital signal/audio speech processor 245, and speech recognition; augmented reality simulation using camera 2310 and camera 2311, geo-location services for display screen 2304 and bluetooth/GPS 26, native App 22, Applet module 21, and display screen 2304.
In the embodiment of the present invention, the Applet module 21 interfaces with the input/output module 23 of the device at the same time, and the Applet module 21 is connected to the middleware platform 30 of the system through a user-customized commercialized SaaS platform 11. The middleware platform 30 uses the parameters established in the cloud service engine 31 and uses at least one API in the API service layer 32 to load, install and run digital services, logic, rules and related content. And executes the Applet instance in the device component 24, as well as the smart functions and services from the App that invoked it, and provides various other services for the App.
The device assembly 24 can be designed, implemented (assembled) and tested as a complete closed unit separate from the device's operating system 240 and native App 22. The term "application software" as used herein may be any software that provides the functionality desired by the user. Thus, the device components 24 can be sold or handed to a number of different users, each of which can install new intelligent functionality located in the native App 22 by loading, installing and running their own application software in the components to meet their own specific requirements for the platform system.
Thus, developers can develop a series of smart functions in the native App 22 using the Applet module 21 and obtain their own App software, which is then added to the device components 24 to turn on the platform system.
In some embodiments, the terminal device 20 further includes a starting module, where the starting module may be an independently configured module, and the starting module may also be integrated inside the CPU 241.
Specifically, the Applet module is configured to be started when the information received by the input/output module 23 meets a preset condition.
In the embodiment of the present invention, the information received by the input/output module 23 may include various categories, for example: voice passwords received through the microphone 2309, images received through the camera 2310 and/or camera 2311, geographic location data acquired through the GPS 26, and the like. When the received information content meets the preset condition, the Applet module 21 is directly started through the starting module, and the native App 22 does not need to be started first, and then the Applet module 21 is started, so that the intelligent function execution efficiency of the terminal device 20 is improved.
Further, the preset condition is determined by preset preference information and/or historical statistical information, where the preset preference information refers to a condition autonomously set by the user, such as: a user sets a specific voice password, and when the user sends the specific voice password to the terminal equipment, the starting module starts the Applet module 21 to execute a corresponding intelligent function;
the historical statistical information refers to that the terminal device collects information such as time, place, weather, brightness, personal historical habits and hobbies, image content and the like in the past use process of the user, performs statistics, and determines the characteristics of the corresponding received information when the user needs to start the Applet module 21 through analysis, for example: the user often uses the intelligent function of physical monitoring when running and taking exercise, and then terminal device can collect the geographical position data that the user often taken exercise, the speed of movement when the user took exercise, route (namely the moving speed of terminal device 20, route) etc. like this, when the user was like going on exercise like usual, obtained terminal device 20's geographical position, moving speed, route etc. through input/output module 23, judge and satisfy preset conditions, then start the module and start Applet module 21 to carry out corresponding intelligent function.
Referring to fig. 10, fig. 10 shows a detailed structure of the native App 22 and the Applet module 21, which is further detailed on the basis of fig. 9. The Applet module 21 is adapted to be designed, implemented (assembled) and tested as a complete closed unit separate from the native App 22.
Wherein the Applet module 21 includes: cache unit 211, local database 212, device input/output function unit 213, Applet logic unit 214, and Applet data unit 215.
The native App 22 also includes: an intelligent function module 221, an embedded function module 222, an information function module 223 and a conversation function module 224; the smart function module 221 is connected to the Applet module 21.
The native App 22 also includes: menu/page/service 225;
in the embodiment of the present invention, the intelligent function module 221 may perform learning according to the historical data and the network data, and after learning, the intelligent capability may be enhanced, and the content provided by the internet protocol address may be provided to the user according to the current demand of the user. The image is also an 'intelligent function' which is continuously enhanced by learning according to historical image data and network image data, and the image can be intelligently modified and synthesized according to time, place, weather, brightness, personal historical habits and hobbies, image content and the like. The Applet module 21 analyzes the device type to determine the logic of the input and output functions. The intelligent function can also judge the device type, configuration and operation logic through detection.
The Applet module 21 runs within a native App 22 on the terminal device (e.g., smartphone, mobile tablet, or smart glasses). The logic management service module 38 allows developers to select their own desired unique content, services, devices and rules that are then transported over a high speed mobile telecommunications network or a wireless data network.
The graphical user interface 220 and operating system parameters of native App 22 are responsible for rendering platform-generated content into smart functionality. The embedded function module 222, the information function module 223, and the dialogue function module 224 of the native App 22 have been provided within the network and provided to the user's terminal device. The device management service module 35 has the following functions: (i) receive the device profile from the Applet module 21, and (ii) send metadata to the Applet management service module 37 that handshakes with the service management service module 36, (iii) immediately processes after reading the content profile in the content management service module 33, and (iv) provide the smart properties and related content described in the smart function module 221 of fig. 10 to the Applet module 21 to cause the Applet module 21 to render the native properties in the native App 22. The loop can be repeated in various terminal devices using the infrastructure and a plurality of functions can be created on a large scale.
Thus, users can develop or otherwise obtain their own native apps 22 and add software to the device components 24. The native App 22 may be sold or handed to a number of different users, each with their own complete platform system, by loading, installing and running their own native Aapp in the components to meet their specific requirements for the platform system.
Referring to fig. 11, an embodiment of the present invention provides a processing method, where an execution main body of the method is the above middleware platform, and the method includes the following specific steps:
step 1101: the management service module receives a service to be processed from an Applet module of the terminal equipment;
step 1102: the management service module determines corresponding managed service according to the service to be processed;
step 1103: the API service layer sends the service to be processed to the corresponding managed service;
step 1104: the API service layer receives the processed business from the corresponding managed service and sends the processed business to the management service module;
step 1105: and the management service module sends the processed service to the Applet module.
In the embodiment of the present invention, when the terminal device needs to use the intelligent function, for example: the method comprises the steps that computer vision, augmented reality, voice recognition and synthesis, geographic position data analysis and the like are achieved, the terminal equipment sends a to-be-processed business related to an intelligent function to a middleware platform through an Applet module, the middleware platform guides the to-be-processed business to a hosting service of an SaaS platform through an internal management service module, a business processing process is completed through the hosting service, and the processed business is fed back to the Applet module of the terminal equipment after the processed business is received from the hosting service.
When the terminal device executes the intelligent function, the intelligent function can be implemented by executing a program instruction in an Applet module, where the program instruction may include at least one of the following:
(1) a first set of program instructions for causing the terminal device to receive logic and content specified by the service for implantation as an intelligent feature in a native App on a device connected to the mobile telecommunications network;
(2) the second group of program instructions enable the terminal equipment to display the service instance in the Applet module and serve as the intelligent characteristic of the terminal equipment;
(3) a third set of program instructions that will implement intelligent features based on the design of the device, hardware and operating system requirements;
(4) a fourth set of program instructions to cause the Applet module to interact with the native App and the instance as an intelligent mobility feature and to transfer content to a graphical user interface of the device;
(5) a fifth set of program instructions for causing the terminal device to request information from the service and present it to the device.
The invention is described below with reference to specific examples:
example one: the intelligent function of computer vision or augmented reality of the terminal equipment is realized. The service to be processed is an image service, and the corresponding hosting service is an image service;
the computer vision may include: image recognition, pattern recognition, image understanding, and the like.
Specifically, the method comprises the following steps:
(1) the content management service module receives an image to be processed from the Applet module;
the image to be processed may be an image acquired by a camera of the terminal device, the Applet module of the terminal device instructs the processor to request the acquired image to be identified through the instruction, and the Applet module sends the acquired image to the content management service module of the middleware platform.
(2) The content management service module matches the image to be processed with a content database and determines a processing request matched with the image to be processed;
the content management service module matches the images to be processed by using an internal content database, and determines corresponding processing requests, wherein the processing requests are used for requesting the content matched with the images to be processed, the display content determined according to the identification of the images to be processed and the like from the image service.
(3) The API service layer sends the image to be processed and the processing request to an image service, and the image service determines a display image according to the image to be processed and the processing request;
and calling at least one corresponding API through the API service layer to send the image to be processed and the processing request to the image service, processing the image by the image service to obtain a display image, and displaying the display image on the terminal equipment to finish the image of the intelligent function of the terminal equipment.
(4) The API service layer receives a display image from the image service and sends the display image to the content management service module;
(5) the content management service module sends the display image to an Applet module;
and the content management service module feeds back the display image to the Applet module through the communication network to complete the intelligent function of the terminal equipment.
Example two: and the intelligent function of language processing or voice synthesis of the terminal equipment is realized. The service to be processed is a voice service, and the corresponding hosting service is a natural language service;
specifically, the method comprises the following steps:
(1) the content management service module receives the voice to be processed from the Applet module;
the voice to be processed may be voice received by a microphone of the terminal device, or voice received by the terminal device through a communication network, an Applet module of the terminal device instructs a processor to request recognition of the received voice through an instruction, and the Applet module sends the received voice to a content management service module of the middleware platform.
(2) The content management service module matches the voice to be processed with the content database and determines a processing request matched with the voice to be processed;
the content management service module matches the voice to be processed by using an internal content database, and determines a corresponding processing request, wherein the processing request is used for requesting the processing of the voice to be processed, including semantic parsing, voice synthesis and the like, from the natural language service.
(3) The API service layer sends the voice to be processed and the processing request to a natural language service, and the natural language service determines voice content information according to the voice to be processed and the processing request;
calling at least one corresponding API through the API service layer to send the voice to be processed and the processing request to the natural language service, and processing the voice and the processing request by the natural language service to obtain voice content information; the speech processing may include: the method comprises the following steps of voice analysis, namely analyzing and identifying the semantics of words or sentences in the voice; synthesizing voice, namely synthesizing a plurality of sections of voice into a whole section of voice and the like; the voice content information is used for displaying or playing the processed voice information on the terminal device, and may be embodied as displaying the voice content in a text form on an image section of the terminal device, or playing the voice content in a form of matching audio through an audio section.
(4) The API service layer receives the voice content information from the image service and sends the voice content information to the content management service module;
(5) the content management service module sends the voice content information to the Applet module;
and the content management service module feeds the voice content information back to the Applet module through the communication network to complete the intelligent function of the terminal equipment.
Example three: and the intelligent function of analyzing the geographical position of the terminal equipment is realized. The service to be processed is a geographical position service, and the corresponding hosting service is an analysis service;
specifically, the method comprises the following steps:
(1) the content management service module receives the geographic position data from the Applet module;
the above-mentioned geographic position data may be geographic position data acquired by a GPS of the terminal device, or geographic position data received by the terminal device through a communication network, or geographic position data received from an internet of things sensor, an Applet module of the terminal device instructs a processor to request analysis of the received geographic position data through an instruction, and the Applet module sends the received geographic position data to a content management service module of the middleware platform.
(2) The content management service module matches the geographic position data with a content database and determines a processing request matched with the geographic position data;
the content management service module matches the geographic location data using an internal content database to determine a corresponding processing request for requesting an analysis of the geographic location data from the analysis service.
(3) The API service layer sends the geographic position data and the processing request to an analysis service, and the analysis service determines a geographic position data analysis result according to the geographic position data and the processing request;
calling at least one corresponding API through the API service layer to send the geographic position data and the processing request to an analysis service, and processing the geographic position data and the processing request by the analysis service to obtain a geographic position data analysis result; the result of the analysis of the geographical location data is used to reflect the geographical location information of the terminal device, for example: a movement path of the terminal device, a main activity area of the terminal device, etc.
(4) The API service layer receives the geographic position data analysis result from the image service and sends the geographic position data analysis result to the content management service module;
(5) the content management service module sends the voice content information to the Applet module;
and the content management service module feeds back the geographic position data analysis result to the Applet module through the communication network to complete the intelligent function of the terminal equipment.
In the embodiment of the invention, the terminal equipment sends the service to be processed to the middleware platform through the Applet module, and the management service module in the cloud service engine of the middleware platform determines the hosting service corresponding to the service to be processed and sends the service to be processed to the hosting service for processing, so that the intelligent function of the terminal equipment is moved to the cloud platform for processing, the influence on the performance of the terminal equipment is reduced, various intelligent functions can be simultaneously supported, and the multi-mode intelligent function requirement of the terminal equipment is met.
Referring to fig. 12, an embodiment of the present invention provides a processing method, where an execution subject of the method is the terminal device described above, and the method includes the following specific steps:
step 1201: the method comprises the steps that an Applet module sends a service to be processed to a management service module of a middleware platform, and the management service module processes the service to be processed;
optionally, before performing step 1201, the start module of the terminal device determines whether the information received by the input/output module meets a preset condition; and when the received information meets the preset condition, starting the Applet module.
In the embodiment of the present invention, the preset condition is determined by preset preference information and/or historical statistical information, where the preset preference information refers to a condition autonomously set by a user, for example: a user sets a specific voice password, and when the user sends the specific voice password to the terminal equipment, the starting module starts the Applet module to execute a corresponding intelligent function;
the historical statistical information refers to that the terminal device collects information such as time, place, weather, brightness, personal historical habits and hobbies, image content and the like in the past use process of the user, performs statistics, and determines the characteristics of the corresponding received information when the user needs to start the Applet module through analysis, for example: the user often uses the intelligent function of physical monitoring when running and taking exercise, then terminal equipment can collect the geographical position data that the user often taken exercise, the speed of motion when the user took exercise, route (promptly terminal equipment's moving speed, route) etc. like this, when the user was like moving as usual, through input/output module acquisition terminal equipment's geographical position, moving speed, route etc. judge and satisfy the preset condition, then start the module and start the Applet module to carry out corresponding intelligent function.
Step 1202: the Applet module receives the processed business from the management service module;
in the embodiment of the present invention, when the terminal device needs to use the intelligent function, for example: the method comprises the steps that computer vision, augmented reality, voice recognition and synthesis, geographic position data analysis and the like are achieved, the terminal equipment sends a to-be-processed business related to an intelligent function to a middleware platform through an Applet module, the to-be-processed business is guided to a hosting service of an SaaS platform through an internal management service module by the middleware platform, a business processing process is completed through the hosting service, and the processed business is fed back to the Applet module of the terminal equipment after the processed business is received from the hosting service.
The above description of the processing flow may refer to the method description on the middleware platform side, and is not described herein again.
Optionally, after step 1202, the method further includes the steps of:
(1) the intelligent function module receives the processed service from the Applet module;
(2) the intelligent function module determines information to be displayed according to the processed service;
(3) the embedded functional module embeds the information to be displayed into a current display interface of the terminal equipment;
in the embodiment of the present invention, the terminal device determines information to be displayed through an intelligent function module in the native App, where the information to be displayed corresponds to an intelligent function of the terminal device, for example: augmented reality, voice synthesis, geographic position data analysis and the like, and accordingly, the information to be displayed can be displayed on a display interface of the terminal equipment in the forms of texts, audios, videos, images and the like.
Specifically, the information to be displayed is embedded into the current display interface of the terminal device by using the embedded function in the native App.
In the embodiment of the invention, the terminal equipment sends the service to be processed to the middleware platform through the Applet module, and the management service module in the cloud service engine of the middleware platform determines the hosting service corresponding to the service to be processed and sends the service to be processed to the hosting service for processing, so that the intelligent function of the terminal equipment is moved to the cloud platform for processing, the influence on the performance of the terminal equipment is reduced, various intelligent functions can be simultaneously supported, and the multi-mode intelligent function requirement of the terminal equipment is met.
The above description is only an embodiment of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (33)

1. A middleware platform disposed in a software as a service (SaaS) platform, the middleware platform comprising: a cloud service engine;
an Application Programming Interface (API) service layer and a plurality of management service modules are arranged in the cloud service engine;
the API service layer is connected with the hosting service of the SaaS platform;
the management service module is connected with an Applet module of the terminal equipment through a communication network;
the management service module is used for receiving the service to be processed from the Applet module;
the management service module is also used for determining corresponding managed service according to the service to be processed;
the API service layer is used for sending the service to be processed to the corresponding managed service;
the API service layer is also used for receiving the processed business from the corresponding managed service and sending the processed business to the management service modules;
and the management service module is also used for sending the processed service to the Applet module.
2. The middleware platform of claim 1 wherein the management service module comprises at least one of:
the system comprises a content management service module, an API management service module, a device management service module, a service management service module, an Applet management service module and a logic management service module.
3. The middleware platform of claim 2 wherein the hosted services include at least one of:
artificial intelligence/machine learning services, image services, natural language services, analytics services, database storage services, computing services, data services, device management services, business services.
4. The middleware platform of claim 3 wherein the content management service module comprises:
a logic editing tool;
a plurality of databases;
a network partition for storing schemas and files for the plurality of databases;
the plurality of databases comprises at least one of:
the system comprises a metadata database, a first API database, a device database, a first service database, an App database, a content database, a first rule database, a summary database, a first heuristic database, a first network database and a logic database.
5. The middleware platform of claim 3 wherein the API management service module comprises:
a logic editing tool;
a plurality of databases;
a network partition for storing schemas and files for the plurality of databases;
the plurality of databases comprises at least one of:
the system comprises a first instance database, a registry database, a protocol database, a key database, a first micro-service database, a second micro-service database and a second API database.
6. The middleware platform of claim 3 wherein the device management service module comprises:
a logic editing tool;
a plurality of databases;
a network partition for storing schemas and files for the plurality of databases;
the plurality of databases comprises at least one of:
file handle database, equipment input/output database, update database, software/hardware configuration identification database, warning database, second rule database, audit log database, second heuristic database, license database, second network database, security certification authorization database, and equipment instance database.
7. The middleware platform of claim 3 wherein the service management service module comprises:
a logic editing tool;
a plurality of databases;
a network partition for storing schemas and files for the plurality of databases;
the plurality of databases comprises at least one of:
a second instance database, a configuration database, a third rule database, a third API database, a second service database, a third service database, and a fourth service database.
8. The middleware platform of claim 3, wherein the Applet management service module comprises:
an Applet manager, an Applet compiler, a container engine, and an Applet database.
9. The middleware platform of claim 3 wherein the logic management service module comprises:
a logic editing tool;
a content management service database, an API management service database, an equipment management service database, a service management service database, and an Applet management service database.
10. The middleware platform of claim 4,
when the service to be processed is an image service, the corresponding hosting service is the image service;
the content management service module is used for receiving the image to be processed from the Applet module;
the content management service module is further configured to match the image to be processed with the content database, and determine a processing request matched with the image to be processed;
the API service layer is also used for sending the image to be processed and the processing request to the image service, and the image service determines a display image according to the image to be processed and the processing request;
the API service layer is also used for receiving the display image from the image service and sending the display image to the content management service module;
and the content management service module is also used for sending the display image to the Applet module.
11. The middleware platform of claim 4,
when the service to be processed is a voice service, the corresponding hosting service is the natural language service;
the content management service module is used for receiving the voice to be processed from the Applet module;
the content management service module is further configured to match the to-be-processed voice with the content database, and determine a processing request matched with the to-be-processed image;
the API service layer is also used for sending the voice to be processed and the processing request to the natural language service, and the natural language service determines voice content information according to the voice to be processed and the processing request;
the API service layer is also used for receiving the voice content information from the natural language service and sending the voice content information to the content management service module;
and the content management service module is also used for sending the voice content information to the Applet module.
12. The middleware platform of claim 4,
when the service to be processed is a geographic position service, the corresponding hosting service is the analysis service;
the content management service module is used for receiving the geographic position data of the terminal equipment from the Applet module;
the content management service module is further configured to match the geographic position data with the content database, and determine a processing request matched with the geographic position data;
the API service layer is also used for sending the geographic position data and the processing request to the analysis service, and the analysis service determines a geographic position data analysis result according to the geographic position data and the processing request;
the API service layer is also used for receiving the geographic position data analysis result from the analysis service and sending the geographic position data analysis result to the content management service module;
and the content management service module is also used for sending the geographic position data analysis result to the Applet module.
13. A terminal device comprises an input/output module and a device assembly, wherein the device assembly comprises an operating system, a native App is arranged in the operating system,
an Applet module is arranged in the native App and is connected with a plurality of management service modules in the middleware platform through a communication network;
the Applet module is used for sending a service to be processed to the management service module, and the management service module processes the service to be processed;
and the Applet module is also used for receiving the processed business from the management service module.
14. The end device of claim 13, wherein the native App comprises:
the intelligent function module, the embedded function module, the information function module and the dialogue function module;
the intelligent function module is connected with the Applet module.
15. The terminal device of claim 13, wherein the Applet module comprises:
the device comprises a cache unit, a local database, a device input/output function unit, an Applet logic unit and an Applet data unit.
16. The terminal device of claim 13,
when the service to be processed is an image service,
the Applet module is used for sending an image to be processed to a content management service module in the management service module;
the Applet module is also used for receiving display images from the content management service module.
17. The terminal device of claim 13,
when the service to be processed is a voice service,
the Applet module is used for sending the voice to be processed to a content management service module in the management service module;
and the Applet module is also used for receiving the voice content information from the content management service module.
18. The terminal device of claim 13,
when the pending service is a geo-location service,
the Applet module is used for sending geographic position data to a content management service module in the management service module;
and the Applet module is also used for receiving a geographic position data analysis result from the content management service module.
19. The terminal device of claim 14,
the intelligent function module is used for receiving the processed service from the Applet module;
the intelligent function module is also used for determining information to be displayed according to the processed service;
and the embedded functional module is used for embedding the information to be displayed into the current display interface of the terminal equipment.
20. The terminal device according to claim 13, wherein the terminal device further comprises: the starting module stores at least one preset condition inside;
and the starting module is used for starting the Applet module when the information received by the input/output module meets the preset condition.
21. The terminal device according to claim 20, wherein the preset condition is determined by preset preference information and/or historical statistical information.
22. A5G artificial intelligence cloud processing system, includes the SaaS platform, the SaaS platform includes trusteeship service, its characterized in that includes: the 5G artificial intelligence cloud processing system further comprises: the middleware platform according to any one of claims 1 to 12 and the terminal device according to any one of claims 13 to 21, the middleware platform being provided in a SaaS platform, the middleware platform being connected to the terminal device through a communication network.
23. A processing method applied to the middleware platform according to any one of claims 1 to 12, the method comprising:
the management service module receives a service to be processed from an Applet module of the terminal equipment;
the management service module determines corresponding managed service according to the service to be processed;
the API service layer sends the service to be processed to the corresponding managed service;
the API service layer receives the processed business from the corresponding managed service and sends the processed business to the management service module;
and the management service module sends the processed service to the Applet module.
24. The method of claim 23,
when the service to be processed is an image service, the corresponding hosting service is the image service;
the management service module receives the service to be processed from an Applet module of the terminal equipment, and the method comprises the following steps:
the content management service module receives an image to be processed from the Applet module;
the management service module determines a corresponding managed service according to the service to be processed, and the method comprises the following steps:
the content management service module matches the image to be processed with the content database and determines a processing request matched with the image to be processed;
the API service layer sends the service to be processed to the corresponding managed service, and the method comprises the following steps:
the API service layer sends the image to be processed and the processing request to the image service, and the image service determines a display image according to the image to be processed and the processing request;
the API service layer receives the processed service from the corresponding managed service, and sends the processed service to the management service module, including:
the API service layer receives the display image from the image service and sends the display image to the content management service module;
the plurality of management service modules send the processed service to the Applet module, and the method comprises the following steps:
and the content management service module sends the display image to the Applet module.
25. The method of claim 23,
when the service to be processed is a voice service, the corresponding hosting service is a natural language service;
the management service module receives the service to be processed from an Applet module of the terminal equipment, and the method comprises the following steps:
the content management service module receives the voice to be processed from the Applet module;
the management service module determines a corresponding managed service according to the service to be processed, and the method comprises the following steps:
the content management service module matches the voice to be processed with the content database and determines a processing request matched with the voice to be processed;
the API service layer sends the service to be processed to the corresponding managed service, and the method comprises the following steps:
the API service layer sends the voice to be processed and the processing request to the natural language service, and the natural language service determines voice content information according to the voice to be processed and the processing request;
the API service layer receives the processed service from the corresponding managed service, and sends the processed service to the management service module, including:
the API service layer receives the voice content information from the natural language service and sends the voice content information to the content management service module;
the plurality of management service modules send the processed service to the Applet module, and the method comprises the following steps:
and the content management service module sends the voice content information to the Applet module.
26. The method of claim 23,
when the business to be processed is the geographic position business, the corresponding hosting service is an analysis service;
the management service module receives the service to be processed from an Applet module of the terminal equipment, and the method comprises the following steps:
the content management service module receives the geographic position data of the terminal equipment from the Applet module;
the management service module determines a corresponding managed service according to the service to be processed, and the method comprises the following steps:
the content management service module matches the geographic position data with the content database and determines a processing request matched with the geographic position data;
the API service layer sends the service to be processed to the corresponding managed service, and the method comprises the following steps:
the API service layer sends the geographic position data and the processing request to the analysis service, and the analysis service determines a geographic position data analysis result according to the geographic position data and the processing request;
the API service layer receives the processed service from the corresponding managed service, and sends the processed service to the management service module, including:
the API service layer receives the geographic position data analysis result from the analysis service and sends the geographic position data analysis result to the content management service module;
the plurality of management service modules send the processed service to the Applet module, and the method comprises the following steps:
and the content management service module sends the geographic position data analysis result to the Applet module.
27. A processing method applied to the terminal device according to any one of claims 13 to 21, the method comprising:
the method comprises the steps that an Applet module sends a service to be processed to a management service module of a middleware platform, and the management service module processes the service to be processed;
and the Applet module receives the processed business from the management service module.
28. The method of claim 27,
when the service to be processed is an image service,
the Applet module sends the service to be processed to a management service module of the middleware platform, and the method comprises the following steps:
the Applet module sends an image to be processed to a content management service module in the management service module;
correspondingly, the Applet module receives the processed service from the management service module, and the processing includes:
the Applet module receives a display image from the content management service module.
29. The method of claim 27,
when the service to be processed is a voice service,
the Applet module sends the service to be processed to a management service module of the middleware platform, and the method comprises the following steps:
the Applet module sends the voice to be processed to a content management service module in the management service module;
correspondingly, the Applet module receives the processed service from the management service module, and the processing includes:
the Applet module receives voice content information from the content management service module.
30. The method of claim 27,
when the pending service is a geo-location service,
the Applet module sends the service to be processed to a management service module of the middleware platform, and the method comprises the following steps:
the Applet module sends geographic position data to a content management service module in the management service module;
correspondingly, the Applet module receives the processed service from the management service module, and the processing includes:
and the Applet module receives the geographic position data analysis result from the content management service module.
31. The method of claim 27, further comprising:
the intelligent function module receives the processed service from the Applet module;
the intelligent function module determines information to be displayed according to the processed service;
and the embedded functional module embeds the information to be displayed into a current display interface of the terminal equipment.
32. The method of claim 27, wherein before the Applet module sends the pending transaction to the management service module of the middleware platform, the method further comprises:
the starting module judges whether the information received by the input/output module meets a preset condition or not;
and when the received information meets a preset condition, starting the Applet module.
33. The method according to claim 32, wherein the preset condition is determined by preset preference information and/or historical statistical information.
CN201910649655.4A 2019-07-18 2019-07-18 Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method Active CN112243016B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910649655.4A CN112243016B (en) 2019-07-18 2019-07-18 Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910649655.4A CN112243016B (en) 2019-07-18 2019-07-18 Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method

Publications (2)

Publication Number Publication Date
CN112243016A true CN112243016A (en) 2021-01-19
CN112243016B CN112243016B (en) 2024-04-23

Family

ID=74167672

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910649655.4A Active CN112243016B (en) 2019-07-18 2019-07-18 Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method

Country Status (1)

Country Link
CN (1) CN112243016B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113347609A (en) * 2021-06-22 2021-09-03 中国科学院计算技术研究所 Wireless intelligent control platform
CN114786140A (en) * 2022-03-24 2022-07-22 兰州飞天网景信息产业有限公司 5G message SaaS cloud platform
CN116258320A (en) * 2022-12-20 2023-06-13 无锡捷通数智科技有限公司 Intelligent office system based on SaaS, data processing method and device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080139112A1 (en) * 2006-12-11 2008-06-12 Hari Prasad Sampath Intelligent personalized content delivery system for mobile devices on wireless networks
CN101969475A (en) * 2010-11-15 2011-02-09 张军 Business data controllable distribution and fusion application system based on cloud computing
US20110321120A1 (en) * 2010-06-24 2011-12-29 Infosys Technologies Limited Method and system for providing masking services
WO2014039866A1 (en) * 2012-09-07 2014-03-13 Oracle International Corporation System and method for providing a service management engine for use with a cloud computing environment
US20140075239A1 (en) * 2012-09-07 2014-03-13 Oracle International Corporation Failure handling in the execution flow of provisioning operations in a cloud environment
CN104966239A (en) * 2015-06-30 2015-10-07 天津爱蔻科技有限公司 Intelligent underwriting platform based on rule engine
CN107612959A (en) * 2017-07-21 2018-01-19 哈尔滨工程大学 A kind of cloud service platform based on cloud micro services Self management
CN109861978A (en) * 2018-12-28 2019-06-07 浙江工业大学 A kind of Internet of Things SaaS platform based on MQTT agreement

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080139112A1 (en) * 2006-12-11 2008-06-12 Hari Prasad Sampath Intelligent personalized content delivery system for mobile devices on wireless networks
US20110321120A1 (en) * 2010-06-24 2011-12-29 Infosys Technologies Limited Method and system for providing masking services
CN101969475A (en) * 2010-11-15 2011-02-09 张军 Business data controllable distribution and fusion application system based on cloud computing
WO2014039866A1 (en) * 2012-09-07 2014-03-13 Oracle International Corporation System and method for providing a service management engine for use with a cloud computing environment
US20140075239A1 (en) * 2012-09-07 2014-03-13 Oracle International Corporation Failure handling in the execution flow of provisioning operations in a cloud environment
CN104966239A (en) * 2015-06-30 2015-10-07 天津爱蔻科技有限公司 Intelligent underwriting platform based on rule engine
CN107612959A (en) * 2017-07-21 2018-01-19 哈尔滨工程大学 A kind of cloud service platform based on cloud micro services Self management
CN109861978A (en) * 2018-12-28 2019-06-07 浙江工业大学 A kind of Internet of Things SaaS platform based on MQTT agreement

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113347609A (en) * 2021-06-22 2021-09-03 中国科学院计算技术研究所 Wireless intelligent control platform
CN113347609B (en) * 2021-06-22 2023-10-03 中国科学院计算技术研究所 Wireless intelligent control platform
CN114786140A (en) * 2022-03-24 2022-07-22 兰州飞天网景信息产业有限公司 5G message SaaS cloud platform
CN116258320A (en) * 2022-12-20 2023-06-13 无锡捷通数智科技有限公司 Intelligent office system based on SaaS, data processing method and device

Also Published As

Publication number Publication date
CN112243016B (en) 2024-04-23

Similar Documents

Publication Publication Date Title
US11107466B2 (en) Digital assistant voice input integration
US20220167026A1 (en) Network based media processing control
CN109710236B (en) Service development and implementation method, device, platform and medium based on shared service
CN111290865A (en) Service calling method and device, electronic equipment and storage medium
CN109408136B (en) Information processing method, information processing apparatus, storage medium, and electronic device
CN112243016B (en) Middleware platform, terminal equipment, 5G artificial intelligence cloud processing system and processing method
CN109933381B (en) Kernel loading method and device
CN111770062B (en) Information processing method, device and storage medium
US11528302B2 (en) Real-time media streams
CN112130866A (en) Application deployment method and related device
US20160247083A1 (en) Recommendation for an individual based on a mood of the individual
CN114217989A (en) Service calling method, device, equipment, medium and computer program between equipment
CN112202744A (en) Multi-system data communication method and device
CN105763545B (en) A kind of BYOD method and device
US8949930B1 (en) Template representation of security resources
CN114222003A (en) Service calling method, system, device, equipment and storage medium
US20180091460A1 (en) Augmenting location of social media posts based on proximity of other posts
CN114365467B (en) Methods, apparatuses, and computer readable media for determining 3GPP FLUS reception capability
CN112597022A (en) Remote diagnosis method, device, storage medium and electronic equipment
CN111343172A (en) Network access authority dynamic processing method and device
CN110855539B (en) Device discovery method, device and storage medium
CN117041353B (en) Task processing method and device, electronic equipment and storage medium
CN115665741A (en) Security service implementation method, device, security service system, equipment and medium
CN116846889A (en) Container arrangement and data access method, electronic device and storage medium
CN115002229A (en) Edge cloud network system, scheduling method, device, system and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant