CN108062492B - Method and electronic device based on label positioning - Google Patents
Method and electronic device based on label positioning Download PDFInfo
- Publication number
- CN108062492B CN108062492B CN201711078494.5A CN201711078494A CN108062492B CN 108062492 B CN108062492 B CN 108062492B CN 201711078494 A CN201711078494 A CN 201711078494A CN 108062492 B CN108062492 B CN 108062492B
- Authority
- CN
- China
- Prior art keywords
- tag
- user
- given
- determining
- given device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 28
- 230000006870 function Effects 0.000 claims description 54
- 230000004044 response Effects 0.000 claims description 9
- 230000003190 augmentative effect Effects 0.000 claims description 8
- 230000003287 optical effect Effects 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 4
- 238000005265 energy consumption Methods 0.000 claims description 2
- 101100327917 Caenorhabditis elegans chup-1 gene Proteins 0.000 description 47
- 238000010586 diagram Methods 0.000 description 42
- 238000004590 computer program Methods 0.000 description 11
- 238000012545 processing Methods 0.000 description 4
- 230000000644 propagated effect Effects 0.000 description 4
- 239000004065 semiconductor Substances 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 238000013475 authorization Methods 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 230000003247 decreasing effect Effects 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 238000004020 luminiscence type Methods 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001427 coherent effect Effects 0.000 description 1
- 238000002405 diagnostic procedure Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000002207 retinal effect Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/10009—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation sensing by radiation using wavelengths larger than 0.1 mm, e.g. radio-waves or microwaves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/10009—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation sensing by radiation using wavelengths larger than 0.1 mm, e.g. radio-waves or microwaves
- G06K7/10297—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation sensing by radiation using wavelengths larger than 0.1 mm, e.g. radio-waves or microwaves arrangements for handling protocols designed for non-contact record carriers such as RFIDs NFCs, e.g. ISO/IEC 14443 and 18092
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
- H04W4/029—Location-based management or tracking services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
- G06K7/1404—Methods for optical code recognition
- G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
- G06K7/1404—Methods for optical code recognition
- G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
- G06K7/1413—1D bar codes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
- G06K7/1404—Methods for optical code recognition
- G06K7/1408—Methods for optical code recognition the method being specifically adapted for the type of code
- G06K7/1417—2D bar codes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06K—GRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
- G06K7/00—Methods or arrangements for sensing record carriers, e.g. for reading patterns
- G06K7/10—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
- G06K7/14—Methods or arrangements for sensing record carriers, e.g. for reading patterns by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation using light without selection of wavelength, e.g. sensing reflected white light
- G06K7/1404—Methods for optical code recognition
- G06K7/1439—Methods for optical code recognition including a method step for retrieval of the optical code
- G06K7/1452—Methods for optical code recognition including a method step for retrieval of the optical code detecting bar code edges
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
- G06Q10/083—Shipping
- G06Q10/0833—Tracking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
- H04W88/02—Terminal devices
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- Toxicology (AREA)
- General Health & Medical Sciences (AREA)
- Electromagnetism (AREA)
- Artificial Intelligence (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Operations Research (AREA)
- Entrepreneurship & Innovation (AREA)
- Development Economics (AREA)
- Quality & Reliability (AREA)
- Computer Networks & Wireless Communication (AREA)
- Primary Health Care (AREA)
- Computer Security & Cryptography (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application relates to a method and an electronic device based on label positioning. For tag-based positioning, the camera captures an image. The display presents an image. The processor identifies a given device tag within the image. The processor also determines a device location based on the given device tag.
Description
Cross Reference to Related Applications
This application claims priority from united states provisional patent application 62/418,514 entitled "PRESENTING EQUIPMENT CONTROLS (presentation device controls)" filed on 2016, month 11, 7 by Thong t.
Technical Field
The subject matter disclosed herein relates to determining a location based on a tag.
Background
The system may be used in a facility such as an industrial environment having multiple instances of equipment. Additionally, many device instances may appear similar and/or identical. As a result, it may be difficult for a user to locate himself in an industrial setting by using the device instance as a landmark.
Disclosure of Invention
An electronic device for tag-based positioning is disclosed. The electronic device includes a camera device, a display, a processor, and a memory. The camera device captures an image. The display presents an image. The memory stores code and credential data executable by the processor. The processor identifies a given device tag within the image. The processor also determines a device location based on the given device tag. A method and a computer program product also perform the functions of the electronic device.
Drawings
In order that the advantages of the embodiments of the invention will be readily understood, a more particular description of the embodiments briefly described above will be rendered by reference to specific embodiments that are illustrated in the appended drawings. Understanding that these drawings depict only some embodiments and are not therefore to be considered to be limiting of its scope, the embodiments will be described and explained with additional specificity and detail through the use of the accompanying drawings in which:
FIG. 1A is a schematic block diagram of a device information system, according to an embodiment;
fig. 1B is a front view of a tablet computer according to an embodiment;
fig. 1C is a perspective view of the wearable device according to the embodiment;
fig. 1D is a perspective view of an augmented reality display according to an embodiment;
FIG. 2A is a schematic block diagram of a credential database, according to an embodiment;
FIG. 2B is a schematic block diagram of a device database, according to an embodiment;
FIG. 2C is a schematic block diagram of device data, according to an embodiment;
FIG. 2D is a schematic block diagram of credential data, according to an embodiment;
FIG. 2E is a schematic block diagram of system data, according to an embodiment;
FIG. 2F is a schematic block diagram of a list of available menus, according to an embodiment;
FIG. 2G is a schematic block diagram of a list of available data sets, according to an embodiment;
FIG. 2H is a schematic block diagram of a list of available functions, according to an embodiment;
fig. 3A is a front view of a device panel according to an embodiment;
FIG. 3B is a front view of an electronic device presenting an example of an apparatus according to an embodiment;
FIG. 3C is a front view of an electronic device presenting a menu according to an embodiment;
FIG. 3D is a front view of an electronic device presenting a menu according to an alternative embodiment;
FIG. 3E is a front view of an electronic device presenting available functions according to an embodiment;
FIG. 3F is a front view of an electronic device presenting available functions according to an alternative embodiment;
FIG. 3G is a front view of an electronic device presenting available data sets in accordance with an embodiment;
FIG. 3H is a front view of an electronic device presenting available data sets in accordance with an alternative embodiment;
FIG. 3I is a front view of an electronic device presenting an example of an accessible apparatus according to an embodiment;
FIG. 3J is a front view of an electronic device presenting an example of an accessible apparatus according to an alternative embodiment;
fig. 3K is an elevation view of identifying a device tag using eye tracking, according to an embodiment;
FIG. 3L is a front view of an identification device tag using a field of view center, under an embodiment;
FIG. 3M is a perspective view of a device tag, according to an embodiment;
FIG. 4 is a schematic block diagram of a computer, according to an embodiment;
fig. 5A is a schematic flow diagram of a device location method according to an embodiment; and
fig. 5B is a schematic flow diagram of a rights determination method according to an embodiment.
Detailed Description
Reference throughout this specification to "one embodiment," "an embodiment," or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, appearances of the phrases "in one embodiment," "in an embodiment," and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise. The enumerated listing of items does not imply that any or all of the items are mutually exclusive and/or mutually exclusive, unless expressly specified otherwise. The terms "a", "an", and "the" also refer to "one or more" unless expressly specified otherwise.
Furthermore, the described features, advantages, and characteristics of the embodiments may be combined in any suitable manner. One skilled in the relevant art will recognize that an embodiment may be practiced without one or more of the specific features or advantages of a particular embodiment. In other instances, additional features and advantages may be recognized in certain embodiments that may not be present in all embodiments.
These features and advantages of the embodiments will become more fully apparent from the following description and appended claims, or may be learned by the practice of the embodiments as set forth hereinafter. As will be appreciated by one skilled in the art, aspects of the present invention may be embodied as a system, method or computer program product. Accordingly, various aspects of the present invention may take the form of: a full hardware implementation; full software implementation (including firmware, resident software, micro-code, etc.); or embodiments combining software and hardware aspects, these forms may be referred to herein generally as a "circuit," module "or" system. Furthermore, aspects of the present invention may take the form of a computer program product embodied in one or more computer-readable media having program code embodied therein.
Many of the functional units described in this specification have been labeled as modules, in order to more particularly emphasize their implementation independence. For example, a module may be implemented as a hardware circuit comprising custom Very Large Scale Integration (VLSI) circuits or gate arrays, or off-the-shelf semiconductors such as logic chips, transistors, or other discrete components. A module may also be implemented in programmable hardware devices such as field programmable gate arrays, programmable array logic, programmable logic devices or the like.
Modules may also be implemented in software for execution by various types of processors. An identified module of program code may, for instance, comprise one or more physical or logical blocks of computer instructions which may, for instance, be organized as an object, procedure, or function. Nevertheless, the executables of an identified module need not be physically located together, but may comprise disparate instructions stored in different locations which, when joined logically together, comprise the module and achieve the stated purpose for the module.
Indeed, a module of program code may be a single instruction, or many instructions, and may even be distributed over several different code segments, among different programs, and across several memory devices. Similarly, operational data within the modules may be identified and illustrated herein, and may be embodied in any suitable form and organized within any suitable type of data structure. The operational data may be collected as a single data set, or may be distributed over different locations including over different storage devices, and may exist, at least partially, merely as electronic signals on a system or network. Where a module or portion of a module is implemented in software, the program code may be stored and/or propagated in one or more computer-readable media.
The computer readable medium may be a tangible computer readable storage medium storing the program code. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, holographic, micromechanical, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing.
More specific examples of the computer-readable storage medium may include, but are not limited to: a portable computer diskette, a hard disk, a random access memory ("RAM"), a read-only memory ("ROM"), an erasable programmable read-only memory ("EPROM" or flash memory), a portable compact disc read-only memory ("CD-ROM"), a digital versatile disc ("DVD"), an optical storage device, a magnetic storage device, a holographic storage medium, a micromechanical storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, and/or store program code for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable medium may also be a computer readable signal medium. A computer readable signal medium may include a propagated data signal with the program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated signal may take any of a variety of forms, including, but not limited to, electrical, electromagnetic, magnetic, optical, or any suitable combination thereof. A computer readable signal medium may be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport program code for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable signal medium may be transmitted using any appropriate medium, including but not limited to wire, fiber optics, Radio Frequency (RF), etc., or any suitable combination of the foregoing.
In one embodiment, a computer-readable medium may include one or more computer-readable storage media and a combination of one or more computer-readable signal media. For example, program code may be propagated as electromagnetic signals over fiber optic cables for execution by a processor, or stored on a RAM storage device for execution by a processor.
Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including: object-oriented programming languages such as Java, Smalltalk, C + +, C #, PHP, and the like; and a conventional procedural programming language such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server as a stand-alone software package. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). The computer program product can be shared, simultaneously serving a plurality of clients, in a flexible, automated manner.
The computer program product may be integrated into a client, server, and network environment by: a computer program product is provided that co-exists with application programs, an operating system and network operating system software and is then installed on clients and servers in an environment where the computer program product will function. In one embodiment, software is identified on the clients and servers including the network operating system in which the computer program product is to be deployed, the software being software required by or working with the computer program product. This includes the network operating system, which is software that enhances the basic operating system by adding network functionality.
Furthermore, the described features, structures, or characteristics of the embodiments may be combined in any suitable manner. In the following description, numerous specific details are provided, such as examples of programming, software modules, user selections, network transactions, database queries, database structures, hardware modules, hardware circuits, and hardware chips, etc., to provide a thorough understanding of embodiments. One skilled in the relevant art will recognize, however, that the embodiments may be practiced without one or more of the specific details, or with other methods, components, materials, and so forth. In other instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring aspects of the embodiments.
Aspects of the embodiments are described below with reference to schematic flow charts and/or schematic block diagrams of methods, apparatuses, systems, and computer program products according to embodiments of the invention. It will be understood that each block of the schematic flow chart diagrams and/or schematic block diagrams, and combinations of blocks in the schematic flow chart diagrams and/or schematic block diagrams, can be implemented by program code. Program code may be provided to a processor of a general purpose computer, special purpose computer, sequencer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the schematic flow chart diagram and/or exemplary block diagram block or blocks.
Program code may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions that: the instructions implement the functions/acts specified in the schematic flow chart diagram and/or exemplary block diagram block or blocks.
The program code may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the program code which executes on the computer or other programmable apparatus provides processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
The schematic flow charts and/or schematic block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of devices, systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the schematic flow chart diagrams and/or schematic block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions in program code for implementing the specified logical function(s).
It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. Other steps and methods may be conceived that are equivalent in function, logic, or effect to one or more blocks, or portions thereof, of the illustrated figures.
Although various arrow types and line types may be employed in the flow chart diagrams and/or block diagram block diagrams, they are understood not to limit the scope of the corresponding embodiments. Indeed, some arrows or other connectors may be used to indicate only the logical flow of the depicted embodiment. For instance, an arrow may indicate a waiting or monitoring period of unspecified duration between enumerated steps of the depicted embodiment. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and program code.
The description of the elements in each figure may refer to elements of previous figures. Like reference numerals designate like elements throughout the figures of alternative embodiments that include the same.
Fig. 1A is a schematic block diagram of a device information system 100. The equipment information system 100 may locate the electronic device 105 and manage the presentation of the equipment information 150 at the equipment instance 160. In the depicted embodiment, the system 100 includes a server 120, a network 115, an electronic device 105, and an apparatus instance 160.
The device instances 160 may be industrial controllers, motor drives, and the like. The network 115 may be the internet, a wide area network, a local area network, a mobile telephone network, a Wi-Fi network, or a combination thereof. The electronic device 105 may be selected from an augmented reality display, a computer tablet, a watch, a wearable device, and a mobile phone. In one embodiment, an augmented reality display is worn on the eyes of a user and displays both physical objects in the user's field of view and virtual objects such as virtual controls. The electronic device 105 may store credential data for a user of the electronic device 105.
The server 120 may store one or more databases used by the electronic device 105. The server 120 and the electronic device 105 may communicate over the network 115.
The electronic device 105 may include a camera 135 and a display 140. The camera 135 may capture an image 145 of the device instance 160 and the device tag 130 disposed on the device instance 160. The device label 130 may be selected from the group consisting of a two-dimensional optical code, a Quick Response (QR) code, a bar code, a Universal Product Code (UPC),Low energy consumption (BLE) tags, Radio Frequency Identifiers (RFID), Near Field Communication (NFC) tags and euro, mastercard, westcard (EMV) tags. In one embodiment, two or more types of device tags 130 may be employed simultaneously. In one embodiment, the device tag 130 is in the code and device reference code.
The system 100 may be used in a facility such as an industrial environment having a plurality of device instances 160. Additionally, many device instances 160 may appear similar and/or identical. As a result, it may be difficult for a user to locate himself in an industrial setting by using the device instance 160 as a landmark. Embodiments described herein determine the device location of the electronic device 105 based on the equipment tag 130, allowing a user of the electronic device 105 to determine his location within the facility.
Device controls 151 are available to all users having physical access to device instance 160. Unfortunately, not all potential users may have the necessary credentials to use the full device information 150 and/or device controls 151. Embodiments described herein determine device permissions for device instance 160 based on the device type and credential data. Embodiments further present the user with device information 150 and/or device controls 151 enabled by device permissions (enable). As a result, the user is only given access to device information 150 that is within the scope of the user's credential data, thereby preventing unauthorized and/or unqualified users from accessing some or all of the device information 150.
Fig. 1B is a front view of tablet computer electronics 105. Tablet computer electronics 105 includes a display 140 and a camera 135 (not shown). Further, tablet electronics 105 includes a computer.
Fig. 1C is a perspective view of the wearable device electronic device 105. The wearable device electronic device 105 is shown as a watch and/or bracelet. The wearable device electronic device 105 includes a display 140 and a camera 135. In one embodiment, the wearable device electronic device 105 comprises a computer.
Fig. 1D is a perspective view of the augmented reality display electronics 105. In one embodiment, the augmented reality display is worn on the user's eyes and displays both physical objects captured by the camera 135 and virtual objects, such as virtual controls, in the user's field of view on an internal display (not shown). In one embodiment, the augmented reality display electronics 105 include a computer.
Fig. 2A is a schematic block diagram of a credential database 200. The credential database 200 may be organized as a data structure in a memory, such as a memory of the server 120 and/or the electronic device 105. The credential database 200 may include a plurality of credential data 255, which will be described in fig. 2D below.
Fig. 2B is a schematic block diagram of the device database 210. The device database 210 may be organized as a data structure in a memory, such as a memory of the server 120 and/or the electronic apparatus 105. The device database 210 may include a plurality of device data 215, which will be described below in fig. 2C.
Fig. 2C is a schematic block diagram of the device data 215. The device data 215 may describe one or more device permissions 230 for the device instance 160. The device data 215 may be organized as a data structure in memory. In the depicted embodiment, the device data 215 includes a device reference code 205, a device type 225, a device location 291, and a plurality of device permissions 230. In addition, each device privilege 230 may include an available menu list 270, an available data set list 275, and an available functions list 280. In one embodiment, the device data 215 includes a part map 287 and an identification vector 423.
The device reference code 205 may uniquely identify a single device instance 160. In one embodiment, the device reference code 205 is a serial number. Alternatively, the device reference code 205 may uniquely identify a set of device instances 160, and the device reference code 205 may include a model number. The device reference code 205 may be encoded in the device tag 130. The device reference code 205 and corresponding device instance 160 may be identified from the device tag 130.
The device type 225 may identify the type of device instance 160. In one embodiment, this type is a single unique device instance 160 such as a controller. Alternatively, the type may be a particular model of the device instance 160. The device type 225 may represent the features and functionality of the device instance 160. The device type 225 may be used to determine which device permissions 230a given user has for the device instance 160. In one embodiment, the device permissions 230 for a given device type 225 are normalized based on user training, experience, and authorization. For example, the user may need to complete a specified workout, have a specified number of hours to use the features and/or functions of the device instance 160, and/or have the appropriate authorization to have a specified device right 230.
Each device privilege 230 may define a coherent set of menus, display data, and functions that can be enabled as device controls 151 and/or device information 150 at the electronic apparatus 105. The device permissions 230 may be organized such that different sets of menus, data, and functions are enabled for users having different credential data 255. The available menu list 270 may include one or more menus that are enabled at the device information 150. The available data set list 275 may include one or more data sets that may be displayed by the device information 150. The list of available functions 280 may include one or more functions of the device information 150 enabled at the device control 151. For example, the first and second lists of available functions 280a and 280b may include an emergency shutdown function. However, only the first list of available functions 280a may enable the diagnostic test function.
Component map 287 may include a visual map of the positioning of components of device instance 160. The component map 287 may include multiple elevations. Each elevation may include one or more components.
The identification vector 423 may encode the location of the device tag 130 as a vector comprising a plurality of elements. In one embodiment, the vector is a binary vector, wherein each element is a binary value. The facility vector may be used to manipulate the identification vector 423 to determine the location of the electronic device 105. Using the facility vector to manipulate the identification vector 423 greatly accelerates the positioning of the device instance 160 within the facility. As a result, the electronic device 105 is quickly identified and located.
Fig. 2D is a schematic block diagram of credential data 255. The credential data 255 may identify the device permissions 230 of the user. The credential data 255 may be organized as a data structure in memory. In the depicted embodiment, the credential data 255 includes a user identifier 220, one or more device types 225, and one or more corresponding device permissions 230.
The user identifier 220 may uniquely identify the user of the electronic device 105. In one embodiment, the user identifier 220 includes one or more biometric credentials of the user, including an image, a fingerprint, a voice print, a retinal scan, and the like. Further, the user identifier 220 may include an identifying alphanumeric string and/or a password.
Each device type 225 may identify a type of device instance 160. The device permissions 230 corresponding to the device type 225 may specify which device information 150 and/or device controls 151 the user has enabled.
Fig. 2E is a schematic block diagram of system data. The system data may be organized as data structures in memory. In the depicted embodiment, the system data includes device location 293, facility vector 431, location vector 435, equipment panel data 437, and location table 439.
The device location 293 may locate the electronic device 105. The device location 293 may be determined from the device location 291. The device position 293 may be set equal to the apparatus position 291. Further, the device location 293 may be modified according to the device location 291. For example, the device location 293 may be estimated from a combination of the device location 291 and the view of the device tag 130 and/or the corresponding device instance 160. In one embodiment, the device position 293 includes the orientation of the electronic device 105. Additionally, the device location 293 may include the orientation of the user.
The facility vector 431 may be a vector that is encoded such that when the facility vector 431 and the identification vector 423 are manipulated together, the location of the device tag 130 and/or the electronic apparatus 105 may be quickly determined. In one embodiment, the location vector 435 is calculated from the identification vector 423 and the facility vector 431. The location vector 435 may be a vector description of the device location 293 and/or the device location 291. The location vector LV 435 may be calculated using equation 1, where IV is the identification vector 423 and FV is the facilities vector 431.
LV IV FV equation 1
The location vector 435 may identify the location of the device tag 130 and/or the electronic apparatus 105. The location table 439 may comprise entries for a plurality of locations indexed by the location vector 435. In one embodiment, the location vector 435 is used as an index into a location table 439 to identify the location of the device tag 130, the device instance 160, and/or the electronic apparatus 105.
The device panel data 437 can record relationships between device instances of a device panel. For example, the device panel data 437 can describe the physical location and logical location of each device instance 160.
Fig. 2F is a schematic block diagram of the available menu list 270 of fig. 2C. The available menu list 270 may be organized as a data structure in memory. In the depicted embodiment, the available memory list 270 includes a plurality of menu list entries 272. Each menu list entry 272 includes a menu 271, corresponding device permissions 230, and a menu log 273.
Each menu 271a to 271c may include a plurality of options that may be selected by the user. Some options may be common to two or more menus 271. Furthermore, some options may be exclusive to one menu 271. Each menu 271a to 271c may be associated with a different device right 230a to 230 c. For example, if the user owns the first device right 230a, only the first menu 271a may be available. Further, if the user does not possess the first device right 230a but possesses the second device right 230b, the second menu 271b may be available to the user.
The menu log 273 may record each instance of the menu 271 that is available to the user. The menu log 273 may include the user identifier 220 and a timestamp of the user. In one embodiment, the menu log 273 records each selection made by the user of the menu 271.
FIG. 2G is a schematic block diagram of the available data set list 275 of FIG. 2C. The available data set list 275 may be organized as a data structure in memory. In the depicted embodiment, the available data set list 275 includes a plurality of data set list entries 276. Each data set entry 276 includes a data set 277, a corresponding device privilege 230, and a data set log 279.
Each data set 277 a-277 c may include multiple data instances. Some data instances may be common to two or more data sets 277. Further, some data instances may be exclusive to one data set 277. Each data set 277 a-277 c may be associated with a different device privilege 230 a-230 c. The first data set 277a may be available to the user with a first device privilege 230a, while the second data set 277b may be available to the user with a second device privilege 230 b.
Each data set log 279 may record each data instance of the data set 277 accessed by the user. The data set log 279 may include the user identifier 220 and a timestamp of the user.
Fig. 2H is a schematic block diagram of the list of available functions 280 of fig. 2C. The list of available functions 280 may be organized as a data structure in memory. In the depicted embodiment, the available functions list 280 includes a plurality of function entries 282. Each function entry 282 includes a function 281, a corresponding device privilege 230, and a function log 283.
Each function 281 may be a function of a device instance 160. In one embodiment, the function is the ability to access the device instance 160. Further, the functionality may initiate actions by the device instance 160. Each function 281a to 281c may be associated with a different device right 230a to 230 c. The first function 281a may be available to the user with a first device right 230a and the second function 281b may be available to the user with a second device right 230 b.
Each function log 283 can record each function 281 employed by the user. The functionality log 283 may include the user identifier 220 and a timestamp of the user.
Fig. 3A is a front view of the device panel 300. The equipment panel 300 may be disposed in an environment such as an industrial facility. The device panel 300 may be a device instance 160. Additionally, the device panel 300 may include a plurality of device instances 160.
The device tags 130 may be provided on one or more device instances 160. In one embodiment, the camera 135 captures an image 145 of the device panel 300. The electronic apparatus 105 may identify a given device tag 130 within the image 145.
Fig. 3B is a front view of the electronic device 105 for the display apparatus panel 300. For simplicity, display 140 of tablet computer electronics 105 is shown. However, the wearable device electronics 105 and the display 140 of the augmented reality display electronics 140 may also be employed. The camera 135 may capture images 145 of one or more device instances 160 and corresponding device tags 130. The electronic device 105 may identify the device tag 130 in the image 145. The electronic apparatus 105 may also identify a given device tag 130.
The processor may further emphasize a given device instance 160b presented in the display 140. In the depicted embodiment, the given device instance 160b is highlighted in the display 140. Highlighting may increase the perceived lighting of a given device instance 160 b. Alternatively, highlighting may reduce the perceived lighting of a given device instance 160 b. In one embodiment, highlighting may modify the color of a given device instance 160 b.
The given device instance 160b may also be one or more given device instances that are adjusted, outlined, and annotated in the display 140. For example, a given device instance 160b may be adjusted between increased and decreased light emission. Additionally, a given device instance 160 may be tuned between a first color and a second color. A given device instance 160 may be delineated with boundaries of increased luminescence, decreased luminescence, modified colors, specified colors such as red or white, and so forth. In one embodiment, a given device instance 160b is annotated with a tag. Further, other device instances 160 surrounding a given device instance 160b may be obscured and/or not displayed, as shown in the depicted embodiment.
FIG. 3C is a front view of the electronic device 105 presenting the first menu 271 a. In the depicted embodiment, the first menu 271a includes a first set of three options. The first menu 271a may be associated with a first device right 230 a. Thus, if the user has the first device right 230a, the user may access the first menu 271a, and the first menu 271a is an available menu for the user. The first menu 271a may be presented to the user as device information 150 and/or device controls 151. The first menu 271a can be presented as a device control 151 of the device instance 160.
FIG. 3D is a front view of the electronic device 105 presenting a second menu 271 b. In the depicted embodiment, the second menu 271b includes a second set of two options. These two options are common to the first menu 271a of fig. 3C. However, these options do not include the third option of the first menu 271 a. The second menu 271b may be associated with a second device right 230 b. If the user has the second device permissions 230b but not the first device permissions 230a, a second menu 271b may be presented to the user as device information 150 and/or device controls 151 on the device instance 160. The second menu 271b may be a menu available to the user.
Fig. 3E is a front view of electronic device 105 presenting available functions 281. In the depicted embodiment, the first available function 281a is presented to the user. In one embodiment, the first available functionality 281a is presented as a device control 151 on the device instance 160. In addition, a first function 281a may be included as the device information 150. If the user has a first device right 230a, a first function 281a may be available to the user.
Fig. 3F is a front view of the electronic device 105 presenting a second available function 281 b. In the depicted embodiment, the second available function 281b is presented to the user. Some of the first available functions 281a of fig. 3E are not included in the second available functions 281 b. If the user has the second device right 230b, a second available function 281b may be available to the user.
Fig. 3G is a front view of the electronic device 105 presenting an available data set 277. In the depicted embodiment, a first available data set 277a is presented that includes three data set instances 315 a-315 c. The first data set 277a may be presented in response to the user having a first device privilege 230a corresponding to the first data set 277 a. In one embodiment, the user may access each data set instance 315 a-315 c of the first data set 277 a. In a certain embodiment, a first data set 277a is presented as device control 151.
FIG. 3H is a front view of the electronic device 105 presenting a second available data set 277 b. In the depicted embodiment, the second available data set 277b is presented to the user in response to the user having a second device privilege 230b corresponding to the second data set 277 b. The second data set 277b does not include the third data set instance 315c of the first data set 277 a.
Fig. 3I is a front view of the electronic device 105 presenting an accessible equipment instance 160. In the depicted embodiment, the user is presented with a first accessible device instance 160 a. The first accessible device instance 160a may be accessed and/or controlled by the user in response to the user having the first device permissions 230 a. In one embodiment, the first accessible device instance 160a is presented as a device control 151.
Fig. 3J is a front view of the electronic device 105 presenting a second instance of accessible equipment 160 b. Some device instances 160 that are available as part of the first accessible device instance 160a of fig. 3I are not included in the second accessible device instance 160 b. The second accessible device instance may be accessed and/or controlled by the user in response to the user having the second device permissions 230 b.
Fig. 3K is a front view of the device tag 130 identified using eye tracking. In the depicted embodiment, the electronic device 105 uses eye tracking to identify the user focus 391. The second camera device 135b may track one or more eyes of the user and identify a user focus 391. The device tag 130 may be identified as the object of the user focus 391. The user focus 391 may be determined from at least one of eye tracking, a center of field of view, and a center of attention.
Fig. 3L is a front view of using the field center 393 to identify a device tag. In the depicted embodiment, the user focus 391 is determined as the center 393 of the field of view of the electronic device 105. The device label within the field of view center 393 may be identified as the object of the user focus 391.
In one embodiment, the attention center is determined as a mathematical pattern of multiple locations corresponding to the user focus 391. Alternatively, note that the center may be determined as a mathematical pattern of locations corresponding to the field of view center 393. The center of attention can be calculated using equations 2 and 3, where CAxIs the horizontal coordinate, CA, within the display 140 of the center of attentionyIs to note the vertical coordinate within the display 140 of the center, n is the number of user focus instances 391, and i is the index of the user focus instances 391.
Fig. 3M is a perspective view of the device tag 130. In the depicted embodiment, the device tag 130 is a QR code that is viewed by the camera 135 at an angle and from a distance. The device tag 130 has a sensing region 133. In addition, the device tag 130 has sensing edges 131, and each sensing edge 131 has a sensing length and a sensing angle with respect to the camera 135.
Fig. 4 is a schematic block diagram of a computer 400. The computer 400 may be implemented as the electronic device 105. Further, the computer 400 may be implemented as the server 120. In one embodiment, computer 400 is implemented as device instance 160. In the depicted embodiment, computer 400 includes a processor 405, memory 410, and communication hardware 415. The memory 410 may include semiconductor memory devices, optical memory devices, hard disk drives, micromechanical memory devices, or a combination thereof. The memory 410 may store code. The processor 405 may execute code. The communication hardware 415 may communicate with other devices and/or the network 115.
Fig. 5A is a schematic flow chart diagram of a device location method 500. The method 500 may locate the electronic device 105 based on the equipment tag 130. Additionally, the method 500 may determine the device permissions 230 based on the device type 225 and credential data 255, as well as current device information 150 and/or device controls 151 enabled by the device permissions 230. The method 500 may be performed by the camera 135 and the computer 400 and/or the processor 405 of one or more of the electronic device 105, the server 120, and the equipment instance 160.
The method 500 begins and, in one embodiment, the processor 405 accesses 505 the credentials database 200 and the device database 210. In one embodiment, the processor 405 synchronizes the credential database 200 and/or the device database 210 from the server 120 to the electronic apparatus 105. Alternatively, processor 405 establishes a link to credential database 200 and/or device database 210 stored on server 120.
The camera 135 may capture 510 an image 145 of the device instance 160. In one embodiment, the camera 135 continuously captures 510 the images 145 as a video stream. Alternatively, the camera 135 may command capture 510 of the image 145 in response to a user. In one embodiment, the camera 135 may capture 510 the image 145 in response to a user focus 391 on the device tag 130 and/or on the device instance 160.
The processor 405 may also identify 515 one or more device tags 130 within the image 145. In one embodiment, the processor 405 parses the device reference code 205 from each device tag 130 to identify the device tag 130 and/or the corresponding device instance 160.
The processor 405 may determine the device location 293 based on one or more device tags 130 within the image 145. In a certain embodiment, the device location 293 is determined 517 based on a given device tag 130 within the image 145. The device location 293 may be based on the device location 291. In a certain embodiment, the device location 293 is set equal to the device location 291 of the first device tag 130. The device location 293 may also be modified by triangulation between two or more device tags 130 to determine the location of the electronic device 105 relative to the first device tag 130.
In one embodiment, the processor 405 determines the orientation of the electronic apparatus 105 relative to the device tag 130 based on the perceived edge 131 of the device tag 130. Additionally, the processor 405 may determine the distance to the device tag 130 based on the perceived size 133 of the device tag 130. The processor 405 may determine the device location DL 293 as shown in equation 4, where MO is the orientation matrix of the electronic device 105, EL is the device location 291, and D is the distance from the electronic device 105 to the device tag 130.
DL-DMO + EL equation 4
In one embodiment, the device position 293 is determined using the identification vector 423 to speed up the determination of the device position 293.
In one embodiment, the processor 405 renders 520 the image 145 using one or more device tags 130 and/or corresponding device instances 160 emphasized in the display 140. The emphasized device tag 130 and/or device instance 160 can be highlighted, adjusted, outlined, and/or annotated.
The processor 405 may receive 525 a selection of a device tag 130. The user may select a given device tag 130 based on the user focus 391 and corresponding commands. Alternatively, a given device tag 130 may be selected based on the field of view center 393 and the corresponding command. In one embodiment, note that a given device tag 130 at the center may be emphasized, and the user may select the emphasized given device tag 130 using a corresponding command. Further, a user may select a given device tag 130 and/or corresponding device instance 160 by touching the given device tag 130 and/or corresponding device instance 160 on the display 140. In one embodiment, if only one device tag 130 is presented 520, that device tag 130 may be automatically selected.
The processor 405 may determine 530 a given device type 225 from the device tag 130. The device type 225 may be determined for the selected device tag 130. In one embodiment, the device reference code 205 is parsed from the device tag. Further, the device reference code 205 may be parsed from a hash (hash) of the device tag 130. The device reference code 205 may be used as an index to identify corresponding device data 215 and device type 225 from the device database 210.
The processor 405 may use the credential data 255 to authenticate 535 the user. In one embodiment, the processor 405 identifies the user using an alphanumeric string of characters and/or a password for the user identifier 220. Further, the processor 405 may authenticate 535 the user using the biometric credential of the user identifier 220. In an alternative embodiment, the processor 405 may use the biometric credential to identify the user and use a password and/or alphanumeric string of the user identifier 220 to authenticate the user.
The processor 405 may determine 545 the user's device permissions 230 based on the device type 225 and the user's credential data 255 as a function of the device type 225 and the credential data 255. For example, if the device instance 160 is the first device type 225a, the user's device permissions 230 may be the corresponding first device permissions 230a recorded in the credential data 255. The determination 545 of the device permissions 230 is described in more detail in FIG. 5B.
The processor 405 may determine 550 a user focus 391 of the user. Further, the processor 405 may present 555 the device information 150 and/or device controls 151 enabled by the device permissions 230, and the method 500 ends. In a certain embodiment, the device information 150 and/or the device controls 151 are only presented when a given device instance 160 corresponding to a given device tag 130 is within the field of view of the electronic apparatus 105. The field of view may be the display 140. Alternatively, the field of view may be a central portion of the display 140. The device information 150 and/or the device controls 151 may be presented by the electronic apparatus 105. Additionally, device information 150 and/or device controls 151 can be presented by device instance 160.
In one embodiment, presenting 555 device information 150 includes: one or more available menus 271 from the available menu list 270 are presented. Additionally, presenting 550 the device information 150 may include: one or more available data sets 277 from the available data set list 275 are presented. In a certain embodiment, presenting 550 the device information 150 may include: one or more functions 281 from the list of available functions 280 are enabled. The menu 271, data set 277 and functionality 281 can be presented via the device controls 151.
In one embodiment, device information 150 and/or device controls 151 are presented 555 based on user focus 391. Device information 150 and/or device controls 151 may be presented 550 at the user focus 391. Alternatively, device information 150 and/or device control 151 may be presented 555 as an offset from user focus 391. In a certain embodiment, device information 150 and/or device controls 151 may be presented 555 without obscuring a given device instance 160.
In one embodiment, device information 150 and/or device controls 151 may be presented 555 near the relevant elements of device instance 160. For example, the error message device information 150 can be presented near the component of the device instance 160 that is generating the error message.
Fig. 5B is a schematic flow diagram of a rights determination method 600. The method 600 may determine the device permissions 230 for the device instance 160. Method 600 may perform step 545 of fig. 5A. The method 600 may be performed by the camera 135 and the computer 400 and/or the processor 405 of one or more of the electronic device 105, the server 120, and the equipment instance 160.
The method 600 begins and, in one embodiment, the processor 405 identifies 605 an element associated with the device instance 160. The element may be one of a menu 271, a data set 277 and a function 281. The processor 405 further determines 610 whether the device permissions 230 associated with the elements in the device data 215 are included in the device permissions 230 associated with the device type 225 of the device instance 160 in the credential data 255 or match the device permissions 230 associated with the device type 225 of the device instance 160 in the credential data 255. If the device permissions 230 associated with the elements in the device data 215 do not match the device permissions 230 associated with the device type 225 of the device instance 160 in the credential data 255, the processor 405 determines 625 whether all of the elements have been tested.
If the device permissions 230 associated with the elements in the device data 215 match the device permissions 230 associated with the device type 225 of the device instance 160 in the credential data 255, the processor 405 enables 615 the elements in the device information 150 and/or the device control 151. As a result, the user may be able to use the enabled elements.
In one embodiment, processor 450 records 620 the enabled component that the user is able to use in the corresponding log for that component. For example, the menu 271, the user identifier 220, and a timestamp may be recorded in the respective menu log 273 in response to enabling the menu 271.
The processor 405 determines 625 whether all elements of the device instance 160 have been tested. If all elements have not been tested, the processor 405 loops to identify 605 another element. If all of the components have been tested, the method 600 ends.
Problem/solution
The user and/or his or her colleagues may not be sure of their location within the industrial facility. Embodiments may locate a user within an industrial facility by determining a device location 293 of the electronic device 105 based on identifying a given equipment tag 130 within an image 145 captured by the electronic device 105. As a result, the user and/or his or her colleagues can immediately determine his or her location.
The device instance 160 may be physically accessible to many users, including unauthorized and/or untrained users. Because it is undesirable and dangerous for an unauthorized user to use device instance 160, it is crucial that only authorized and trained users with the correct credentials be able to fully use device information 150 and/or device controls 151. Additionally, some device information 150 should not be provided to unauthorized users. Embodiments described herein restrict access to device information 150 and/or device controls 151 by using device tag 130 to determine device permissions 230 for a user. As a result, only the appropriate device information 150 and/or device controls 151 are enabled and presented to the user, such that an untrained and/or unauthorized user does not abuse the device information 150 and/or device controls 151.
This written description uses examples to disclose the invention, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal languages of the claims.
Claims (10)
1. An electronic device, comprising:
a camera device that captures an image;
a display that presents the image;
a processor;
a memory storing credential data and code executable by the processor to:
identifying a given device tag within the image based on a user focus determined from eye tracking;
determining a device location of the electronic apparatus based on the given equipment tag identifying an equipment location of an equipment instance; and
determining an orientation of a user relative to the given device tag,
wherein the processor further performs:
determining a given device type from the given device tag;
determining device permissions from the given device type and the credential data; and
presenting device information enabled by the device permissions,
wherein the processor authenticates a user using the credential data.
2. The electronic apparatus of claim 1, the processor further to present device information based on a user focus.
3. The electronic apparatus of claim 1, wherein presenting the device information comprises: one or more of the available menus, available data sets, and available functions are presented.
4. The electronic apparatus of claim 1, wherein the device information is presented only when a given device corresponding to the given device tag is in a field of view of the electronic apparatus.
5. The electronic apparatus of claim 1, wherein the device permissions comprise a list of available menus, a list of available data sets, and a list of available functions.
6. The electronic device of claim 1, wherein the processor further performs:
presenting the image in a manner that emphasizes the given device label; and
receiving a selection of the given device tag from the image.
7. The electronic device of claim 1, wherein the equipment tag is selected from the group consisting of a two-dimensional optical code, a Quick Response (QR) code, a bar code, a universal product code(UPC)、Low energy consumption (BLE) tags, Radio Frequency Identifiers (RFID), Near Field Communication (NFC) tags and the group consisting of continental cards, mastercard, westcard (EMV) tags.
8. The electronic device of claim 1, wherein the electronic device is selected from the group consisting of an augmented reality display, a computer tablet, a watch, a wearable device, and a mobile phone.
9. A method of tag-based positioning, comprising:
identifying, using a processor, a given device tag within an image captured by a camera based on a user focus determined from eye tracking;
determining a device location based on the given device tag identifying a device location;
determining an orientation of a user relative to the given device tag;
determining a given device type from the given device tag;
determining device permissions from the given device type and credential data; and
presenting device information enabled by the device permissions,
wherein the credential data is used to authenticate a user.
10. A non-transitory computer-readable storage medium storing code executable by a processor to perform operations comprising:
identifying a given device tag within an image captured by a camera based on a user focus determined from eye tracking;
determining a device location based on the given device tag identifying a device location;
determining an orientation of a user relative to the given device tag;
determining a given device type from the given device tag;
determining device permissions from the given device type and credential data; and
presenting device information enabled by the device permissions,
wherein the credential data is used to authenticate a user.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110931272.3A CN113743141A (en) | 2016-11-07 | 2017-11-06 | Method and electronic device based on label positioning |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201662418514P | 2016-11-07 | 2016-11-07 | |
US62/418,514 | 2016-11-07 | ||
US15/719,246 US10032053B2 (en) | 2016-11-07 | 2017-09-28 | Tag based location |
US15/719,246 | 2017-09-28 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110931272.3A Division CN113743141A (en) | 2016-11-07 | 2017-11-06 | Method and electronic device based on label positioning |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108062492A CN108062492A (en) | 2018-05-22 |
CN108062492B true CN108062492B (en) | 2021-09-07 |
Family
ID=62064646
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110931272.3A Pending CN113743141A (en) | 2016-11-07 | 2017-11-06 | Method and electronic device based on label positioning |
CN201711078494.5A Active CN108062492B (en) | 2016-11-07 | 2017-11-06 | Method and electronic device based on label positioning |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110931272.3A Pending CN113743141A (en) | 2016-11-07 | 2017-11-06 | Method and electronic device based on label positioning |
Country Status (4)
Country | Link |
---|---|
US (3) | US10032053B2 (en) |
EP (1) | EP3321869B1 (en) |
CN (2) | CN113743141A (en) |
BR (1) | BR102017023538A2 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10032053B2 (en) * | 2016-11-07 | 2018-07-24 | Rockwell Automation Technologies, Inc. | Tag based location |
US10831267B1 (en) * | 2019-03-07 | 2020-11-10 | Facebook Technologies, Llc | Systems and methods for virtually tagging objects viewed by friends and influencers |
US10991128B2 (en) * | 2019-06-06 | 2021-04-27 | Shmuel Ur Innovation Ltd. | Markers for augmented reality |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1768299A (en) * | 2003-02-07 | 2006-05-03 | 夏普株式会社 | Focused state display device and focused state display method |
CN102750006A (en) * | 2012-06-13 | 2012-10-24 | 胡锦云 | Information acquisition method |
CN102780772A (en) * | 2012-07-16 | 2012-11-14 | 泸州品创科技有限公司 | Logistics positioning, authenticating and monitoring system and working method thereof |
CN104520799A (en) * | 2012-05-04 | 2015-04-15 | 索尼电脑娱乐美国公司 | User input processing with eye tracking |
CN104903818A (en) * | 2012-12-06 | 2015-09-09 | 爱福露恩斯公司 | Eye tracking wearable devices and method for use |
CN205427892U (en) * | 2016-04-22 | 2016-08-03 | 欧阳华 | System is utilized to two -dimensional code information security |
Family Cites Families (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060000911A1 (en) * | 2002-05-07 | 2006-01-05 | Amit Stekel | Automatic certification, identification and tracking of remote objects in relative motion |
US20090146782A1 (en) * | 2007-12-05 | 2009-06-11 | Symbol Technologies, Inc. | Singulation of radiofrequency identification tags |
US20110173127A1 (en) | 2010-01-08 | 2011-07-14 | Albert Ho | System and method used for configuration of an inspection compliance tool with machine readable tags and their associations to inspected components |
US20120019557A1 (en) * | 2010-07-22 | 2012-01-26 | Sony Ericsson Mobile Communications Ab | Displaying augmented reality information |
KR101083245B1 (en) | 2011-01-31 | 2011-11-14 | 주식회사 서전지구 | Regional information extraction method, regional information output method, and apparatus for the same |
US9606992B2 (en) * | 2011-09-30 | 2017-03-28 | Microsoft Technology Licensing, Llc | Personal audio/visual apparatus providing resource management |
US10387484B2 (en) * | 2012-07-24 | 2019-08-20 | Symbol Technologies, Llc | Mobile device for displaying a topographical area defined by a barcode |
US20140263674A1 (en) * | 2013-03-15 | 2014-09-18 | Conformis, Inc. | Systems, Methods, and Apparatus for Integrating Scannable Codes in Medical Devices |
US9049469B2 (en) * | 2013-04-03 | 2015-06-02 | Roy S. Melzer | Encryption and decryption of visible codes for real time augmented reality views |
WO2015163834A1 (en) | 2014-04-23 | 2015-10-29 | Gürzumar Süleyman Ataullah | Internet based administration of reminder notifications by a computer system |
CN104008361B (en) * | 2014-06-16 | 2017-05-31 | 北京握奇智能科技有限公司 | A kind of two-dimensional code scanning positioning indicating method and system |
KR101584261B1 (en) * | 2014-11-17 | 2016-01-21 | 현대오트론 주식회사 | Battery management system and method |
US10108832B2 (en) * | 2014-12-30 | 2018-10-23 | Hand Held Products, Inc. | Augmented reality vision barcode scanning system and method |
US20160239085A1 (en) | 2015-02-18 | 2016-08-18 | Lenovo (Singapore) Pte, Ltd. | Force indication of a boundary |
US10032053B2 (en) * | 2016-11-07 | 2018-07-24 | Rockwell Automation Technologies, Inc. | Tag based location |
-
2017
- 2017-09-28 US US15/719,246 patent/US10032053B2/en active Active
- 2017-10-31 BR BR102017023538-6A patent/BR102017023538A2/en not_active Application Discontinuation
- 2017-11-06 CN CN202110931272.3A patent/CN113743141A/en active Pending
- 2017-11-06 CN CN201711078494.5A patent/CN108062492B/en active Active
- 2017-11-07 EP EP17200390.7A patent/EP3321869B1/en active Active
-
2018
- 2018-06-15 US US16/010,130 patent/US10395072B2/en active Active
-
2019
- 2019-07-10 US US16/508,145 patent/US10846492B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN1768299A (en) * | 2003-02-07 | 2006-05-03 | 夏普株式会社 | Focused state display device and focused state display method |
CN104520799A (en) * | 2012-05-04 | 2015-04-15 | 索尼电脑娱乐美国公司 | User input processing with eye tracking |
CN102750006A (en) * | 2012-06-13 | 2012-10-24 | 胡锦云 | Information acquisition method |
CN102780772A (en) * | 2012-07-16 | 2012-11-14 | 泸州品创科技有限公司 | Logistics positioning, authenticating and monitoring system and working method thereof |
CN104903818A (en) * | 2012-12-06 | 2015-09-09 | 爱福露恩斯公司 | Eye tracking wearable devices and method for use |
CN205427892U (en) * | 2016-04-22 | 2016-08-03 | 欧阳华 | System is utilized to two -dimensional code information security |
Also Published As
Publication number | Publication date |
---|---|
EP3321869B1 (en) | 2022-04-20 |
BR102017023538A2 (en) | 2018-05-29 |
CN113743141A (en) | 2021-12-03 |
US20180129838A1 (en) | 2018-05-10 |
US10846492B2 (en) | 2020-11-24 |
US20190332831A1 (en) | 2019-10-31 |
CN108062492A (en) | 2018-05-22 |
US10395072B2 (en) | 2019-08-27 |
US10032053B2 (en) | 2018-07-24 |
US20180307875A1 (en) | 2018-10-25 |
EP3321869A1 (en) | 2018-05-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20200026920A1 (en) | Information processing apparatus, information processing method, eyewear terminal, and authentication system | |
US11670058B2 (en) | Visual display systems and method for manipulating images of a real scene using augmented reality | |
US9690601B2 (en) | Dynamic profile switching based on user identification | |
CN108062492B (en) | Method and electronic device based on label positioning | |
CN106060378A (en) | Apparatus and method for setting camera | |
US20150153922A1 (en) | Systems and methods for unlocking a wearable device | |
US11611880B2 (en) | Display apparatus and display method | |
US9614838B1 (en) | Taking a picture of a one-time use passcode and using the picture to authenticate | |
CN105095721A (en) | Fingerprint authentication display device and method | |
JP2019522277A (en) | Terminal device password unlocking method, apparatus, and terminal device | |
US10853513B1 (en) | Data storage using image objects shown in a real-time view | |
KR20130082979A (en) | User personalized recommendation system based on fingerprint identification | |
KR20130082980A (en) | User personalized recommendation system based on face-recognition | |
CN106156593B (en) | A kind of method and device verified using screenshot | |
US20220353258A1 (en) | Generating an evaluation-mask for multi-factor authentication | |
CN108062493B (en) | Device label based emphasis device | |
US11003868B2 (en) | Filtering display data | |
US11159840B2 (en) | User-aware remote control for shared devices | |
CN112765620A (en) | Display control method, display control device, electronic device, and medium | |
WO2018143779A1 (en) | Method for displaying video related service, storage medium, and electronic device therefor | |
US11783724B1 (en) | Interactive training apparatus using augmented reality | |
WO2017213800A1 (en) | Computing device to generate a security indicator | |
WO2023055346A1 (en) | Key selection for an extended reality keyboard | |
WO2023048719A1 (en) | Private display for head mountable device authentication | |
CN114207584A (en) | Display device capable of switching integration mode |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |