CN113760168A - Interactive screen based on array type perception interaction module, and method and system thereof - Google Patents

Interactive screen based on array type perception interaction module, and method and system thereof Download PDF

Info

Publication number
CN113760168A
CN113760168A CN202110950437.1A CN202110950437A CN113760168A CN 113760168 A CN113760168 A CN 113760168A CN 202110950437 A CN202110950437 A CN 202110950437A CN 113760168 A CN113760168 A CN 113760168A
Authority
CN
China
Prior art keywords
content
screen
information
nfc
content information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110950437.1A
Other languages
Chinese (zh)
Inventor
陈闻杰
范圣韬
牛康宇
郭培扬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
East China Normal University
Original Assignee
East China Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by East China Normal University filed Critical East China Normal University
Priority to CN202110950437.1A priority Critical patent/CN113760168A/en
Publication of CN113760168A publication Critical patent/CN113760168A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The application provides an interactive screen based on an array type perception interactive module, a method and a system thereof, wherein the screen comprises: the array type perception interaction module comprises an NFC inductance coil array and is used for inducing a magnetic field signal broadcasted by the mobile equipment in real time so as to determine the relative position between the mobile equipment and the array type perception interaction module, acquiring equipment state information of the mobile equipment after triggering touch response and extracting touch position information on a corresponding screen; the system module is used for analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; and identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information. The application can greatly enrich the interaction between the screen and the mobile device in the variety of scenes, breaks through the limitation of application of two technical fields, realizes innovation and fusion, improves the popularization degree of the NFC technology, and the limitation of the touch screen technology at present.

Description

Interactive screen based on array type perception interaction module, and method and system thereof
Technical Field
The invention relates to the technical field of NFC communication interaction, in particular to an interactive screen based on an array type perception interaction module, and a method and a system thereof.
Background
The existing touch interactive technology is represented by the NFC technology, which is developed from the radio frequency technology, and the application modes of the NFC technology are card mode, card reader mode, and peer-to-peer mode. The card simulation mode is the most common, and is mainly used in various scenes needing to use an IC radio frequency card, and the smart phone can be simulated into a card recorded with radio frequency signals according to corresponding protocol contents to obtain services under corresponding scenes, such as various company access controls, subway gates, pos machine payment and the like. And the card reader mode is used for controlling the mobile phone to continuously scan by using a specific radio frequency, and after corresponding label information is scanned, a coil in the label can generate current and return recorded related information to the mobile phone. The corresponding labels are divided into a passive label and an active label, and the common application scene is bank card management app and the anti-counterfeiting function of valuables. In the peer-to-peer mode, the information sending and receiving functions of the NFC module are fully utilized, and two devices with NFC functions can be linked to realize peer-to-peer data transmission. This mode can be used for two smart phones to touch exchange data.
The above three modes are commonly used in the NFC technology, and currently, the most common mode in the market belongs to a card simulation mode, and the public system service accessed by each large manufacturer actually brings convenience to consumers. But the popularity of NFC technology has decreased dramatically except in limited scenarios. The core reason is that a scanning device with a radio frequency identification function is required to interact with a mobile phone simulated card in a card simulation mode state, such as a POS (point of sale) machine and a subway gate, so that very high hardware requirements are provided for interaction. The card reader mode and the peer-to-peer mode are mainly subject to software requirements, for example, you need to identify a certain type of tag (for example, bank card of a bank) and you must download a corresponding app (bank app), and the peer-to-peer mode is also performed when you need to use a certain software.
In addition, the existing mainstream touch screen technology can better realize the interaction process of the touch sliding operation of the mobile phone, but no matter from technical details and application modes, the existing touch screen can only identify whether the touch action of a foreign object (such as a finger and an induction pen) occurs or not, but cannot identify the information of the foreign object, and cannot generate any information communication with the interaction foreign object, such as a smart phone, a smart watch and the like. Colloquially, the touch screen only knows where it has been touched, whether it is sliding left or right. However, it is not known who touched the object, and the touched object is in what state, and it cannot transmit more information to the object, and only the change is displayed on the screen. This is not sufficient in the existing application environment.
Based on the above problem, the application provides one kind and will allow the user to use wearing formula equipment such as smart mobile phone, smart watch, intelligent bracelet to carry out touching formula interaction with the screen based on the NFC technique to can obtain different interaction results according to touching different contents on the screen, and break through the limitation on two technical field, realize the innovation and merge, improve NFC technique popularity, and the present limitation of touch screen technique.
Disclosure of Invention
In view of the above-mentioned shortcomings of the prior art, it is an object of the present application to provide an interactive screen based on an array-type perceptual interactive module, and a method and system thereof, to solve at least one problem existing in the prior art.
To achieve the above and other related objects, the present application provides an interactable screen based on an array-type cognitive interaction module for interacting with a mobile device having an NFC module, the screen including: the array type perception interaction module comprises an NFC inductance coil array and is used for inducing a magnetic field signal broadcasted by the mobile equipment in real time so as to determine the relative position between the mobile equipment and the array type perception interaction module, acquiring equipment state information of the mobile equipment after triggering touch response and extracting touch position information on a corresponding screen; the control module is used for analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information; and judging the priority of the first content information and the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable an array type perception interaction module to broadcast a second cloud data file capable of acquiring the second content from a cloud so as to enable a mobile device to acquire and display the second content.
In an embodiment of the present application, the array-type perceptual-interactive module includes: the NFC inductive coil array is composed of a plurality of NFC inductive coil units and is densely distributed below the screen through mutual arrangement; the NFC inductance coil array is electrically connected with the control module; each NFC inductance coil unit in the NFC inductance coil array is used for inducing a magnetic field signal broadcasted by the mobile equipment in real time.
In an embodiment of the application, the NFC inductive coil array is further configured to trigger a touch response when a distance between the NFC inductive coil array and the magnetic field signal satisfies a preset condition or the number of the NFC inductive coil units inducing the magnetic field signal reaches a preset value; extracting coordinate information of the NFC inductive coil unit which induces the strongest magnetic field signal as touch position information on a screen; the touch position information and the equipment state information are transmitted to the control module by generating corresponding current signals; the control module is further configured to modulate a second cloud data file, which enables the second content to be acquired by the cloud, on the NFC inductive coil unit, which senses the strongest magnetic field signal and corresponds to the touch position on the screen, and enable the NFC inductive coil unit to broadcast the second content to the outside, so that the mobile device can acquire and display the second content.
In an embodiment of the present application, the NFC inductor array is powered on and controlled by a chip, so that bidirectional communication can be achieved; the NFC inductive coil array coordinate tag information can be correspondingly recorded when the position of the screen changes according to the displayed first content or the second content.
In an embodiment of the present application, the device status information further includes: any one or more of the combination of a device serial number, a device model, a device Identity (ID), a device name, a Bluetooth device name, a timestamp and an interaction flow ID.
In an embodiment of the present application, the first cloud data file and the second cloud data file are structural bodies of structured boot data, and include: jump path information of the first content or the second content and first content information or second content information containing key information of the first content or the second content can be acquired from the cloud link; the first content and the second content include: application content or data; wherein the data comprises: any one of images, audio, video, and files; the first content information and the second content information include: any one or more of APP identification, version information, function module identification, content timestamp, time node, progress state and link address; or any one or more of data format, data size, data name, creation time, and modification time.
In an embodiment of the application, when the first content has a higher priority, the first content currently displayed by the corresponding mobile device is acquired from the cloud according to the jump path information corresponding to the first content obtained by analyzing the first cloud data file, and the first content is displayed on the screen; or when the second content has higher priority, generating a second cloud data file capable of acquiring the second content by the cloud according to the second content information; and broadcasting the second cloud data file through the array type perception interaction module, so that the mobile device can obtain second content currently displayed on the corresponding screen touch position from a cloud end by analyzing the second cloud data file after receiving the second content.
In an embodiment of the application, the determining the priority of the first content information and the second content information based on the touch position includes any one or more of the following combinations: the priority of the second content information corresponding to the default setting screen is the highest, so that the mobile equipment can only acquire and display the second content; or, the priority of the first content information corresponding to the mobile device may be set to be the highest by default, so that only screen acquisition is realized and the first content is displayed; when the first content information and the second content information are both application program content or are both data, the priority of the first content information is higher; when the first content information or the second content information is empty, the priority is the lowest; the priority of the first content information and the second content information for the application program content is higher than that for the data.
To achieve the above and other related objects, the present application provides an interaction method applied to an interactable screen based on an array-type perceptual interaction module, the method comprising; the method comprises the steps of inducing a magnetic field signal broadcasted by the mobile equipment in real time to determine the relative position between the mobile equipment and the magnetic field signal, acquiring equipment state information of the mobile equipment after triggering touch response, and extracting touch position information on a corresponding screen; analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information; and judging the priority of the first content information and the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable an array type perception interaction module to broadcast a second cloud data file capable of acquiring the second content from a cloud so as to enable a mobile device to acquire and display the second content.
To achieve the above and other related objects, the present application provides an interactive system, comprising: interactive screens as described above, and mobile devices; wherein the mobile device is provided with an NFC module.
In summary, the present application provides an interactive screen based on an array-type perceptual-interactive module, and a method and a system thereof, which have the following advantages:
this application will allow the user to use smart mobile phone, smart watch, wearable equipment such as intelligent bracelet to carry out the touching formula with the screen and are interactive based on the NFC technique. The method can realize that the screen can be touched by hardware such as a mobile phone, can know the state of the mobile phone, can transmit related information, and can obtain different interaction results according to different contents on the touch screen. Interaction under multiple scenes between the screen and the mobile device can be greatly enriched, the limitation of application of two technical fields is broken through, innovation and fusion are realized, the popularization degree of the NFC technology is improved, and the current limitation of the touch screen technology is limited.
Drawings
Fig. 1 is a schematic structural diagram of an interactive system applying an interactive screen according to an embodiment of the present application.
Fig. 2 is a schematic structural diagram of an array-type perceptual-interactive module according to an embodiment of the present application.
Fig. 3 is a schematic view illustrating a scene of an interactive system applying an interactive screen according to an embodiment of the present application.
Fig. 4 is a flowchart illustrating an interaction method applied to an interactive screen according to an embodiment of the present invention.
Detailed Description
The following description of the embodiments of the present application is provided by way of specific examples, and other advantages and effects of the present application will be readily apparent to those skilled in the art from the disclosure herein. The present application is capable of other and different embodiments and its several details are capable of modifications and/or changes in various respects, all without departing from the spirit of the present application. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Embodiments of the present application will be described in detail below with reference to the accompanying drawings so that those skilled in the art to which the present application pertains can easily carry out the present application. The present application may be embodied in many different forms and is not limited to the embodiments described herein.
In order to clearly explain the present application, components that are not related to the description are omitted, and the same reference numerals are given to the same or similar components throughout the specification.
Throughout the specification, when a component is referred to as being "connected" to another component, this includes not only the case of being "directly connected" but also the case of being "indirectly connected" with another element interposed therebetween. In addition, when a component is referred to as "including" a certain constituent element, unless otherwise stated, it means that the component may include other constituent elements, without excluding other constituent elements.
When an element is referred to as being "on" another element, it can be directly on the other element, or intervening elements may also be present. When a component is referred to as being "directly on" another component, there are no intervening components present.
In addition to the reason of the low popularity of the NFC technology, there is a limitation in the application of the touch screen technology.
Touch screen technology is currently divided into two types, namely a resistance screen and a capacitance screen. The resistance screen is a touch screen technology which realizes accurate positioning by utilizing resistance change caused by concave-convex deformation of the screen along with the change of pressure on the surface of the touch screen; the capacitive touch screen is formed by sticking a layer of transparent special metal conductive substance on the surface of glass. When a finger touches the metal layer, the capacitance of the electric shock changes, so that the frequency of an oscillator connected with the electric shock changes, and the touch position can be determined and corresponding feedback can be generated by measuring the frequency change.
The existing mainstream touch screen technology can better realize the interaction process of the touch sliding operation of the mobile phone, but no matter from technical details and application modes, the existing touch screen can only identify whether the touch action of a foreign object (such as a finger and an induction pen) occurs or not, but cannot identify foreign object information (such as mobile phone information), and cannot generate any information communication with the interaction foreign object.
Aiming at the application limitation of an NFC technology and a touch screen technology, the application innovatively provides an interactive screen based on an array type perception interaction module, and a method and a system thereof. The method can realize that the screen can be touched by hardware such as a mobile phone, can know the state of the mobile phone, can transmit related information, and can obtain different interaction results according to different contents on the touch screen.
Briefly, the interactive screen of the present application can mainly realize the following three functions:
1) the state in the mobile equipment can be identified and the relevant information transmitted by the mobile equipment can be received when the mobile equipment is touched;
2) when the touch occurs, the screen can identify the corresponding position touched by the mobile equipment and the content information of the corresponding position;
3) the screen can send the content information of the touched point to the mobile device at the moment the touch occurs.
In conclusion, the application can greatly enrich the interaction between the screen and the mobile device in various scenes, breaks through the application limitation of the two technical fields, realizes innovation and fusion, and improves the popularization of the NFC technology and the current limitation of the touch screen technology.
Fig. 1 is a schematic structural diagram of an interactive system of an application interactive screen according to an embodiment of the present application. As shown, the screen 100 is used for interacting with a mobile device 200 with an NFC module, and the screen 100 includes;
the array type perceptual interaction module 110 includes an NFC inductor array, and is configured to sense a magnetic field signal broadcast by the mobile device 200 in real time to determine a relative position with the mobile device 200, acquire device status information of the mobile device 200 after triggering a touch response, and extract touch position information on the corresponding screen 100.
Preferably, the device status information includes, but is not limited to: device serial number, device model, device identity ID, device name, bluetooth device name, timestamp, and interaction flow ID, etc. are used to identify the configuration information of the interaction and the mobile device 200 itself. The device status information is mainly used to confirm identity information of the mobile device 200, establish interaction, track interaction device status information, record interaction flow, and the like, and also can provide other communication connection paths between the mobile device 200 and the screen 100.
In this application, the mobile device 200 is provided with an NFC module. Preferably, the mobile device 200 also has a number of commonly used applications or applets loaded thereon; preferably, the mobile device 200 includes: smart mobile phone, notebook computer, PAD, intelligent wrist-watch, intelligent glasses, display screen all-in-one, smart TV, intelligent stereo set, intelligent robot etc..
The array type sensing interaction module 110 of the present application is provided with a plurality of NFC inductive coil units to form an NFC inductive coil array, so that the relative position between the array type sensing interaction module and the mobile device 200 can be accurately determined through sensed signals.
Secondly, the triggering conditions of the touch response include: when the mobile device approaches the screen to a certain distance or touches the screen. Since the NFC module or device is disposed between the screen 100 and the mobile device 200, the touch between the screen 100 and the mobile device 200 may be a physical real touch or a virtual touch that can achieve a touch response when reaching a certain sensing distance. Specific embodiments are described in detail below in the first embodiment and the second embodiment.
Preferably, when the user needs to interact, the NFC module of the mobile device is located close to the content displayed on the screen 100 that needs to interact without unlocking the screen 100.
For example, the mobile device 200 is a mobile phone, and when the mobile phone approaches the screen 100 of the present application, the mobile phone may emit a radio frequency signal or a magnetic field signal broadcasted in real time (i.e., the untargeted magnetic field signal emits a signal or broadcasts to the outside in real time), where the magnetic field signal includes device status information corresponding to the mobile phone. When the screen 100 senses a radio frequency signal or a magnetic field signal, device status information corresponding to the mobile device 200 can be obtained, so that a user can know who the mobile device sends the signal, and know what application programs are currently opened by the mobile phone, what contents are displayed, and under an agreed protocol or setting, the contents displayed by the mobile phone are displayed, or data transmission is realized with the mobile phone.
In the present application, after the device status information and the interaction of the mobile device 200 are obtained, a connection in a communication mode such as wif or bluetooth may be established according to the device status information, so as to assist in transmitting the interactive data or files. Preferably, the communication means includes, but is not limited to: any one or a plurality of combinations of 2G/3G/4G/5G, Bluetooth, infrared, NB-IoT, Rola, Zigbee, MavLink, WIFI, GPRS, GSM and Ethernet.
In one or more implementations, the interaction implemented according to the communication connection may include: screen projection of the application program content is achieved according to the established wifi communication connection mode; and/or realizing data file transmission according to the established Bluetooth communication connection mode.
For example, some APP applications and their contents may implement screen projection of application contents according to an established wifi communication connection. In addition, when some data files such as PDF and the like need to be transmitted, the data file transmission can be realized according to the established Bluetooth communication connection mode. To increase the flexibility and compatibility of the interactive screen 100 of the present application in transmitting data or information.
The control module 120 is configured to parse the first cloud data file in the device status information to obtain first content information corresponding to first content currently displayed by the mobile device 200, and identify second content information corresponding to second content currently displayed at the touch position on the screen 100 according to the touch position information; and determining priorities of the first content information and the second content information based on the touch position, so as to enable the screen 100 to acquire and display the first content, or enable the array-type awareness interaction module 110 to broadcast a second cloud data file, which is capable of acquiring the second content from the cloud, so as to enable the mobile device 200 to acquire and display the second content.
Accordingly, the array-type perceptual-interaction module 110 is further configured to: receiving a first cloud data file analyzed from the device status information broadcast by the mobile device 200, or sending a second cloud data file generated by the screen 100 to the mobile device 200.
Briefly, the first content information or the second content information is mainly used to characterize the content or data of the application program currently opened by the mobile device 200 or the screen 100, and the data includes: any one of images, audio, video, and files; such as the song currently played by the music APP, and the progress of playing.
Specifically, the first content information and the second content information include, but are not limited to: any one or more of APP identification, version information, function module identification, content timestamp, time node, progress state and link address; or any one or more of data format, data size, data name, creation time, and modification time.
First high in the clouds data file, second high in the clouds data file specifically can be the structure of structuralized guide data, and it includes: jump path information of the first content or the second content and first content information or second content information containing key information of the first content or the second content can be acquired from the cloud link.
The transmission distance of the NFC point-to-point mode is short, and the transmission speed is low. For example, the transmission speed of 424kb/s is far away from the fastest 3mb/s speed of 4.0 of Bluetooth, so that the practicability is not high except for simple business card and picture transmission.
In order to improve the interaction speed and the use experience, the interaction can be completed at the moment of touch. The data or information interaction service form is realized by relying on cloud application. For example, the screen 100 transmits only the structured boot data of the corresponding cloud application, so as to boot the mobile device 200 to open a cloud storage file. For example, a payment interface of a cloud applet is opened, or different services may be provided by other cloud applications.
The structure is mainly used for guiding the mobile device 200 to open the storage file in the cloud. Therefore, after the control module 120 analyzes the first content information or the second content information, the main key information of the first content information or the second content information is extracted, and then the key information is sent to the mobile device 200, and the mobile device 200 searches and pulls according to the key information by using the cloud, so that the purpose of quickly acquiring the corresponding application content can be achieved.
Specifically, the first content information and/or the second content information include, but are not limited to: any one or more of APP identification, version information, function module identification, content timestamp, time node, progress state and link address; or any one or more of data format, data size, data name, creation time, and modification time.
The first content information and/or the second content information comprise a plurality of pieces of key information, and then a cloud data file capable of acquiring corresponding application content by using a cloud is generated according to the key information, so that the screen 100 or the mobile device 200 can acquire corresponding content information by linking to the cloud.
In one or more embodiments, the corresponding cloud data file is generated according to the content information, for example, as follows:
the current state of the mobile phone and the software information running on the screen 100, such as running the kuku video, may be: { activity: youku; content: qmid 2903; time: (2, 30) }, only a part of the information identifiers are shown here. The corresponding explanation is as follows: the active application is youku, 2903 numbered video is played, and the current playing time is 2 minutes and 30 seconds. In addition, after the screen 100 receives the content information and obtains the content information through the cloud, a confirmed empty data packet can be returned without any mobile phone operation, and if possible, an activity: null: content: null; time: null }; alternatively, a null packet may be sent to the screen 100 when no software is running on the handset.
Usually, some APP applications and their contents may adopt the above-mentioned interactive method in the form of a structure, and certainly, a mode of communication connection may also be adopted, such as a screen projection of the application contents according to an established wifi communication connection mode. In addition, when some data files such as PDF and the like need to be transmitted, the data file transmission can be realized according to the established Bluetooth communication connection mode.
Corresponding to the present application, there should be a corresponding program in the mobile device 200 (e.g. mobile phone) that can send the self status and parse the information returned by the screen 100. The program can be woken up at the moment of touch occurrence to complete the interaction.
It should be noted that the mobile device 200 that the user needs to interact with before the interaction should have the media program required for the interaction, but the media program may also be embedded in the operating system of the mobile device 200 itself and thus not visible to the user. This is different from the existing card reader mode and the point-to-point mode, which are mainly subject to software.
This application is different with current card reader mode and the point-to-point mode then mainly be restricted to the software, the application that this application relates to be mobile device 200 on the installation arbitrary application can, in brief, in this application one or more real-time examples, what APP has on the cell-phone, just can realize interacting with screen 100 to this APP, if utilize music broadcast APP, map navigation APP, through touching screen 100, can realize utilizing the high in the clouds to acquire on the webpage or continue broadcast music, map navigation etc. on the procedure under on screen 100, and need not additionally download alone again and realize the application that the function must carry on.
As shown in fig. 2, the structural diagram of the array-type perceptual-interactive module is shown. As shown, the array-type perceptual-interactive module 110 includes: the NFC inductor array 111 is composed of a plurality of NFC inductor units 112, and is densely arranged below the screen 100 by being mutually arranged; the NFC inductor array 111 is electrically connected to the control module 120; each NFC inductive coil unit 112 in the NFC inductive coil array 111 is configured to induce a magnetic field signal broadcast by the mobile device 200 in real time.
In this application, the NFC inductive coil array 111 is further configured to trigger a touch response when a distance between the inductive magnetic field signals meets a preset condition or the number of the NFC inductive coil units 112 inducing the magnetic field signals reaches a preset value; extracting coordinate information of the NFC inductive coil unit 112 which induces the strongest magnetic field signal as touch position information on the screen 100; and transmits touch position information and device state information to the control module 120 by generating a corresponding current signal.
Accordingly, the control module 120 is further configured to modulate a second cloud data file capable of acquiring a second content from a cloud onto the NFC inductive coil unit 112 sensing the strongest magnetic field signal corresponding to the touch position on the screen 100, and enable the NFC inductive coil unit 112 to broadcast outwards, so that the mobile device 200 can acquire and display the second content.
Briefly, the array-type perceptual-interactive module 110 is a dense deployment direct modulation scheme. In this scheme, the NFC inductor array 111 is densely arranged below the screen 100, and after being mutually arranged and densely arranged, the control module 120 monitors and controls the NFC inductor array 111. When the interaction occurs, the NFC inductor unit 112 at the corresponding position of the screen 100 induces a magnetic field signal from the mobile device 200 (e.g., a smart phone) and generates a corresponding current signal to transmit the phone information and the touch coordinate information to the control module 120. The control module 120 may identify the content of the touch occurrence on the screen 100 according to the coordinates, and then modulate the jump path information of the corresponding cloud application on the NFC inductive coil unit 112 at the corresponding location and return the jump path information to the NFC module of the mobile device 200. The mobile device 200 automatically deconstructs the structure, recombines the parameters and the path, and can pull the applet interfaces deployed in advance at different cloud ends according to the jump path information to complete interaction and acquire the service interface.
In an embodiment of the present application, the NFC inductor array 111 is powered on and controlled by a chip, so that bidirectional communication can be achieved; the NFC inductive coil array coordinate tag information can be correspondingly recorded when the position of the screen changes according to the displayed first content or the second content.
It should be noted that some conventional coordinate tag schemes are passive static tags, and only record screen coordinate position information, which is not changed. However, in the present application, active dynamic marks are used, for example, in an application where a file is transferred by touching from a computer desktop, a file icon is dragged to change a position from a position a to a position b, tag information at the original position a may become empty, and coil/tag information behind a new icon position b helps to point to the file, so that the screen 100 may change a tag according to display content to record the dynamic change process information.
In the present application, it is not difficult to find that the screen 100 does not determine whether to receive or transmit when the mobile device 200 makes contact with the screen 100, and therefore, the control module 120 also sets a priority logic setting for reception and transmission. The method specifically comprises the following steps:
the priorities of the first content information and the second content information are determined based on the touch position, so that the screen 100 can acquire and display the first content, or the array-type awareness interaction module 110 can broadcast a second cloud data file with the second content acquired by the cloud, so that the mobile device 200 can acquire and display the second content.
When the first content has a higher priority, acquiring the first content currently displayed by the corresponding mobile device 200 from the cloud according to the jump path information corresponding to the first content obtained by analyzing the first cloud data file, and displaying the first content on the screen 100; or when the second content has higher priority, generating a second cloud data file capable of acquiring the second content by the cloud according to the second content information; and the second cloud data file is broadcasted through the array-type sensing interaction module 110, so that the mobile device 200 obtains, after receiving the second cloud data file, the second content currently displayed at the touch position of the corresponding screen 100 from the cloud by analyzing the second cloud data file.
Specifically, the determining of the priority of the first content information and the second content information based on the touch position includes any one or more of the following combinations:
A. the priority of the second content information corresponding to the default setting screen 100 is the highest, so that only the mobile device 200 is enabled to acquire and display the second content; alternatively, the priority of the first content information corresponding to the mobile device 200 may be set to be the highest by default, so that only the screen 100 is enabled to acquire and display the first content;
in short, under this rule, it is possible to set a scene in which only one of the display contents is accepted. For example, the method is suitable for scenes such as advertisement show windows, that is, the provider (merchant) of the screen 100 does not need to obtain relevant information of the user mobile phone, and only the screen 100 needs to provide commodity content to the user mobile phone.
B. When the first content information and the second content information are both application program content or are both data, the priority of the first content information is higher.
For example, assuming that the common applications such as video, audio, pictures, maps, social contacts, etc. are of the same priority, when the application contents of this priority are displayed on both the screen 100 and the mobile device 200, the mobile device 200 can be held by the user to be more active and targeted, and therefore, in this case, the first content information displayed on the mobile device is set to have a better priority, so as to enable the screen 100 to display the content displayed on the mobile device 200.
For another example, when the user wants to obtain the content displayed on the screen 100, he or she can exit the current application on the handheld mobile device 200, so as to easily lower the priority of the first content information on the mobile device 200, and then the mobile device 200 can obtain the content displayed on the screen. It is clearly more convenient to operate the mobile device 200 held in the user's hand relative to the operating screen 100.
C. And when the first content information or the second content information is empty, the priority is the lowest.
For example, the mobile device 200 (e.g., a smart phone) may generate a first cloud data file according to the current content of the application program thereon, and extract the first content information if the content is available, or leave the first cloud data file empty if the content is not available. The priority logic is: firstly, judging whether the first content information analyzed according to a first cloud data file is empty, if not, acquiring the current application program content corresponding to the mobile equipment 200 from a cloud according to the first content information, namely, preferentially processing a receiving task; if the current application program content is empty, the sending task is processed again, second content information corresponding to the current application program content at the touch position of the screen 100 is identified according to the touch position information, and a second cloud data file capable of acquiring the corresponding application program content by using a cloud is generated.
D. The priority of the first content information and the second content information for the application program content is higher than that for the data.
It should be noted that, the priority of the first content information and the priority of the second content information can be set or adjusted at any time, so as to be suitable for different scenes, and thus, the interactive service of sending or receiving information and data can be completed orderly and reasonably.
Preferably, the interactable screen 100 described herein may be adapted to: the application scenarios of the computer display, the vehicle-mounted central control screen, the show window advertisement screen, the public place information screen, etc. are not limited, and all scenarios applicable to interaction with the mobile device 200 are covered in the protection scope of the present application. The mobile device 200 includes: intelligent wearing equipment or removal end equipment such as smart mobile phone, PAD, intelligent wrist-watch, smart glasses.
For example, the interactive screen 100 described herein can implement the following usage scenarios:
1) the interactive screen 100 is fabricated as a computer monitor, such as the scene diagram shown in fig. 3.
A user can touch a file on a desktop by using a mobile phone to directly acquire the file by using the mobile phone;
the user can directly open the website in the mobile phone by touching a certain webpage in the computer browser by using the mobile phone;
the user can use the mobile phone to touch different software icons in the computer browser to acquire different contents, for example, touch a player in the mobile phone to play a movie on a computer, and touch music software in the mobile phone to play corresponding music;
the user can also touch the blank of the computer to establish a certain connection state, and directly slide files, information, texts and the like in the mobile phone to the desktop of the computer.
2) When the interactive screen 100 is manufactured as an on-vehicle central control screen of a vehicle:
after the user can navigate the corresponding place on the mobile phone, the user can touch the blank position of the large central control screen, and the vehicle can automatically navigate to the corresponding position.
3) When the interactive screen 100 is made as a public showcase:
the interactive screen 100 can display different advertisement show windows in public places, for example, video advertisements can be played, different positions in the same picture correspond to different commodities, such as clothes, ornaments, bags and the like on a model, or tables, chairs, household appliances, decorative pictures and the like in a home scene, a user can touch corresponding commodities in the interactive screen 100 by using a mobile phone, the mobile phone can judge the corresponding position of each commodity in the current picture at the current moment, and automatically pops up a payment interface of a cloud applet of the corresponding commodity to complete a purchasing action.
Fig. 4 is a schematic flow chart of the interaction method according to an embodiment of the present application. The method is applied to an interactive screen based on an array type perception interaction module as described in fig. 1 or 2, and as shown, the method comprises;
step S401: the method comprises the steps of inducing a magnetic field signal broadcasted by the mobile equipment in real time to determine the relative position between the mobile equipment and the magnetic field signal, acquiring equipment state information of the mobile equipment after triggering touch response, and extracting touch position information on a corresponding screen;
step S402: analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information; and judging the priority of the first content information and the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable an array type perception interaction module to broadcast a second cloud data file capable of acquiring the second content from a cloud so as to enable a mobile device to acquire and display the second content.
It should be noted that the content of each step of the method is based on the same concept as the embodiment in the interactive screen described in the present application, and the technical effect brought by the content is the same as the embodiment in the interactive screen described in the present application, so that the details are not repeated herein.
In summary, the present application provides an interactive screen based on an array-type perceptual-interactive module, and a method and a system thereof, wherein the screen includes: the array type perception interaction module comprises an NFC inductance coil array and is used for inducing a magnetic field signal broadcasted by the mobile equipment in real time so as to determine the relative position between the mobile equipment and the array type perception interaction module, acquiring equipment state information of the mobile equipment after triggering touch response and extracting touch position information on a corresponding screen; analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information; and judging the priority of the first content information and the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable an array type perception interaction module to broadcast a second cloud data file capable of acquiring the second content from a cloud so as to enable a mobile device to acquire and display the second content.
The application effectively overcomes various defects in the prior art and has high industrial utilization value.
The above embodiments are merely illustrative of the principles and utilities of the present application and are not intended to limit the invention. Any person skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present application. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present application.

Claims (10)

1. An interactable screen based on an array-type cognitive interaction module, for interacting with a mobile device having an NFC module, the screen comprising:
the array type perception interaction module comprises an NFC inductance coil array and is used for inducing a magnetic field signal broadcasted by the mobile equipment in real time so as to determine the relative position between the mobile equipment and the array type perception interaction module, acquiring equipment state information of the mobile equipment after triggering touch response and extracting touch position information on a corresponding screen;
the control module is used for analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information;
and judging the priority of the first content information and the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable an array type perception interaction module to broadcast a second cloud data file capable of acquiring the second content from a cloud so as to enable a mobile device to acquire and display the second content.
2. The interactable screen of claim 1 wherein said array-type perceptual interaction module comprises: the NFC inductive coil array is composed of a plurality of NFC inductive coil units and is densely distributed below the screen through mutual arrangement;
the NFC inductance coil array is electrically connected with the control module;
each NFC inductance coil unit in the NFC inductance coil array is used for inducing a magnetic field signal broadcasted by the mobile equipment in real time.
3. The interactive screen of claim 2, wherein the NFC inductive coil array is further configured to trigger a touch response when a distance to which the magnetic field signal is sensed satisfies a preset condition or the number of NFC inductive coil units to which the magnetic field signal is sensed reaches a preset value; extracting coordinate information of the NFC inductive coil unit which induces the strongest magnetic field signal as touch position information on a screen; the touch position information and the equipment state information are transmitted to the control module by generating corresponding current signals;
the control module is further configured to modulate a second cloud data file, which enables the second content to be acquired by the cloud, on the NFC inductive coil unit, which senses the strongest magnetic field signal and corresponds to the touch position on the screen, and enable the NFC inductive coil unit to broadcast the second content to the outside, so that the mobile device can acquire and display the second content.
4. The interactive screen of claim 2, wherein the NFC inductor array is powered on and controlled by a chip, enabling bidirectional communication; the NFC inductive coil array coordinate tag information can be correspondingly recorded when the position of the screen changes according to the displayed first content or the second content.
5. The interactable screen of claim 1 wherein said device status information further comprises: any one or more of the combination of a device serial number, a device model, a device Identity (ID), a device name, a Bluetooth device name, a timestamp and an interaction flow ID.
6. The interactive screen of claim 1, wherein the first cloud data file and the second cloud data file are a structure of structured boot data, comprising: jump path information of the first content or the second content and first content information or second content information containing key information of the first content or the second content can be acquired from the cloud link;
the first content and the second content include: application content or data; wherein the data comprises: any one of images, audio, video, and files;
the first content information and the second content information include: any one or more of APP identification, version information, function module identification, content timestamp, time node, progress state and link address; or any one or more of data format, data size, data name, creation time, and modification time.
7. The interactive screen of claim 1, wherein when the first content has a higher priority, the first content currently displayed by the corresponding mobile device is obtained from the cloud according to the jump path information corresponding to the first content obtained by parsing the first cloud data file, and the first content is displayed on the screen;
or when the second content has higher priority, generating a second cloud data file capable of acquiring the second content by the cloud according to the second content information; and broadcasting the second cloud data file through the array type perception interaction module, so that the mobile device can obtain second content currently displayed on the corresponding screen touch position from a cloud end by analyzing the second cloud data file after receiving the second content.
8. The interactive screen of claim 1, wherein the determining the priority of the first content information and the second content information based on the touch position comprises any one or more of the following combinations:
the priority of the second content information corresponding to the default setting screen is the highest, so that the mobile equipment can only acquire and display the second content; or, the priority of the first content information corresponding to the mobile device may be set to be the highest by default, so that only screen acquisition is realized and the first content is displayed;
when the first content information and the second content information are both application program content or are both data, the priority of the first content information is higher;
when the first content information or the second content information is empty, the priority is the lowest;
the priority of the first content information and the second content information for the application program content is higher than that for the data.
9. An interaction method is applied to an interactive screen based on an array type perception interaction module, and comprises the following steps of;
the method comprises the steps of inducing a magnetic field signal broadcasted by the mobile equipment in real time to determine the relative position between the mobile equipment and the magnetic field signal, acquiring equipment state information of the mobile equipment after triggering touch response, and extracting touch position information on a corresponding screen;
analyzing a first cloud data file in the equipment state information to obtain first content information corresponding to first content currently displayed by the mobile equipment; identifying second content information corresponding to second content currently displayed at the touch position on the screen according to the touch position information; and judging the priority of the first content information and the second content information based on the touch position so as to enable a screen to acquire and display the first content or enable an array type perception interaction module to broadcast a second cloud data file capable of acquiring the second content from a cloud so as to enable a mobile device to acquire and display the second content.
10. An interactive system, characterized in that the interactive system comprises: an interactable screen, and mobile device, as claimed in any one of claims 1-8; wherein the mobile device is provided with an NFC module.
CN202110950437.1A 2021-08-18 2021-08-18 Interactive screen based on array type perception interaction module, and method and system thereof Pending CN113760168A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110950437.1A CN113760168A (en) 2021-08-18 2021-08-18 Interactive screen based on array type perception interaction module, and method and system thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110950437.1A CN113760168A (en) 2021-08-18 2021-08-18 Interactive screen based on array type perception interaction module, and method and system thereof

Publications (1)

Publication Number Publication Date
CN113760168A true CN113760168A (en) 2021-12-07

Family

ID=78790347

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110950437.1A Pending CN113760168A (en) 2021-08-18 2021-08-18 Interactive screen based on array type perception interaction module, and method and system thereof

Country Status (1)

Country Link
CN (1) CN113760168A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130094126A1 (en) * 2011-10-14 2013-04-18 Benjamin M. Rappoport Electronic Devices Having Displays with Openings
US20140051354A1 (en) * 2012-08-20 2014-02-20 Lg Electronics Inc. Mobile terminal, display device and method for controlling the mobile terminal
KR20150115024A (en) * 2014-04-01 2015-10-14 에이큐 주식회사 Display information providing system using multi-NFC antenna and method thereof
CN112486363A (en) * 2020-10-30 2021-03-12 华为技术有限公司 Cross-device content sharing method, electronic device and system
US20210125450A1 (en) * 2017-04-25 2021-04-29 Sharp Kabushiki Kaisha Control device, control method of control device, and communication device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130094126A1 (en) * 2011-10-14 2013-04-18 Benjamin M. Rappoport Electronic Devices Having Displays with Openings
US20140051354A1 (en) * 2012-08-20 2014-02-20 Lg Electronics Inc. Mobile terminal, display device and method for controlling the mobile terminal
KR20150115024A (en) * 2014-04-01 2015-10-14 에이큐 주식회사 Display information providing system using multi-NFC antenna and method thereof
US20210125450A1 (en) * 2017-04-25 2021-04-29 Sharp Kabushiki Kaisha Control device, control method of control device, and communication device
CN112486363A (en) * 2020-10-30 2021-03-12 华为技术有限公司 Cross-device content sharing method, electronic device and system

Similar Documents

Publication Publication Date Title
KR102019967B1 (en) User terminal apparatus, display apparatus, server and control method thereof
CN104615655B (en) Information recommendation method and device
KR101228478B1 (en) Method and system of providing application, and mobile terminal thereof
US20100318420A1 (en) Apparatus and method for providing media advertisement service using human body communication
US20180020252A1 (en) Information display method, channel management platform, and terminal
KR20160144665A (en) User equipment for recognizing object and displaying database matching result, control method thereof and computer readable medium having computer program recorded therefor
CN106469183A (en) Page rendering method and device, page data processing method and client
CN103679475A (en) E-commerce shopping guide platform
KR101622466B1 (en) System and method for providing content
CN101763345A (en) Information providing system and method
CN106445956A (en) Shopping data management method and apparatus
WO2017078414A1 (en) Method for providing content using first screen of portable communication terminal
CN106575409A (en) Object recognition-based retargeting advertisement product recommendation server, control method therefor, and recording medium having computer program recorded thereon
CN113760168A (en) Interactive screen based on array type perception interaction module, and method and system thereof
Pyykkönen et al. Designing tangible user interfaces for NFC phones
CN113687759B (en) Interactive screen based on discrete perception interaction module, method and system thereof
CN103179207A (en) Data transmission method and system as well as device
CN113687760A (en) Interactive screen based on stacked perception interactive module, and method and system thereof
TWI519997B (en) Server, user apparatus and terminal device
CN104700122B (en) A kind of information interaction system and method
US20150178774A1 (en) Method and system for targeting advertisements on display devices based on user's nfc based transaction and web browsing activities
KR102291886B1 (en) Digital signage and method for controlling the same
KR102353015B1 (en) Digital signage and method for controlling the same
TW201025184A (en) Ubiquitous proxy mobile service method and system, and computer recordable storage medium
KR20140105674A (en) Coupon service method and apparatus

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination