WO2020062876A1

WO2020062876A1 - Service provision method and system based on optical label

Info

Publication number: WO2020062876A1
Application number: PCT/CN2019/086001
Authority: WO
Inventors: 李江亮; 方俊; 牛旭恒
Original assignee: 北京外号信息技术有限公司
Priority date: 2018-09-25
Filing date: 2019-05-08
Publication date: 2020-04-02
Also published as: CN110942115A; TW202013255A

Abstract

A service provision method and system based on an optical label (200). By means of a terminal device carried by a user scanning an optical label (200) associated with a service provider, so as to enter a related service access interface and generate a service request, and determining, on the basis of the scanning of the optical label (200), position information of the terminal device, and the service provider providing a corresponding service according to the determined position information and the service request. Thus, when a service requirement is generated, a user can use the carried terminal device to scan the related optical label (200) in the field of view thereof anytime and anywhere to request a service, and enjoy the service within a short time, without the address and the delivery time being limited.

Description

基于光标签的服务提供方法和***Method and system for providing service based on light tags

技术领域Technical field

本发明涉及位置服务，尤其涉及一种基于光标签的服务提供方法及***。The present invention relates to location services, and in particular, to a method and system for providing services based on light tags.

背景技术Background technique

随着互联网的广泛普及，各个行业都在尝试利用互联网平台来发展新的服务提供方式，“互联网+”成为了研究热点。例如网络购物、基于扫码的移动支付等已经是被大众普遍接受的服务方式。但这样的服务提供方式通常是基于预先设定的位置提供的服务，用户或服务提供者中的一方必须明确知道对方的预定位置才能进行准确的服务交互。以网络购物为例，通常要求用户在购物时提供固定地址以进行配送，并且至少需要数小时、通常是1-3天的送货时间，用户才能在其提供的固定地址处收到所购买的商品。然而，这种服务提供方式并不能满足用户随时随地产生的服务需求。With the widespread popularity of the Internet, various industries are trying to use the Internet platform to develop new service delivery methods, and "Internet +" has become a research hotspot. For example, online shopping and code-based mobile payment are already widely accepted service methods. However, such a service providing method is usually a service provided based on a preset location, and one of the user or the service provider must clearly know the other party's predetermined location in order to perform accurate service interaction. Taking online shopping as an example, users are usually required to provide a fixed address for delivery when shopping, and it takes at least several hours, usually 1-3 days, for the user to receive the purchased address at the fixed address provided commodity. However, this method of service provision cannot meet the service needs of users anytime, anywhere.

发明内容Summary of the Invention

因此，本发明的目的在于提供一种基于光标签的新的服务提供方法和***，能快速及时地满足用户实时产生的服务需求。Therefore, an object of the present invention is to provide a new service providing method and system based on a light tag, which can quickly and timely meet service requirements generated by users in real time.

本发明的目的是通过以下技术方案实现的：The object of the present invention is achieved by the following technical solutions:

一方面，本发明提供了一种基于光标签的服务提供方法，包括：In one aspect, the present invention provides a light tag-based service providing method, including:

S1)通过用户携带的终端设备对与服务提供者关联的光标签进行图像采集；S1) Perform image collection on the optical tag associated with the service provider through the terminal device carried by the user;

S2)基于所采集的光标签图像获取与服务提供者相关的信息并确定终端设备相对于光标签的位置；S2) Obtaining information related to the service provider based on the collected light tag image and determining the position of the terminal device relative to the light tag;

S3)根据所获取的与服务提供者相关的信息生成服务请求，并将所述服务请求和所述终端设备的位置信息发送给相应的服务提供者，其中所述终端设备的位置信息是基于终端设备相对于光标签的位置来确定的；S3) Generate a service request according to the obtained information related to the service provider, and send the service request and the location information of the terminal device to the corresponding service provider, where the location information of the terminal device is based on the terminal The position of the device relative to the light tag is determined;

S4)由服务提供者基于收到的服务请求和所述终端设备的位置信息来提供所请求的服务。S4) The requested service is provided by the service provider based on the received service request and the location information of the terminal device.

在上述方法中，所述光标签可以与一个或多个服务提供者相关联。在上述方法中还可以包括：In the above method, the light tag may be associated with one or more service providers. The above method may further include:

将所述服务请求发送给可提供所请求的服务的多个服务提供者；Sending the service request to a plurality of service providers that can provide the requested service;

选择其中一个服务提供者来为用户提供所请求的服务。Select one of the service providers to provide the requested service to the user.

上述方法中，还可包括利用所述终端设备对用户当前位置附近的光标签进行图像采集以确定终端设备相对于该光标签的位置并将其作为新的位置信息发送给服务提供者；由服务提供者响应于收到自终端设备发送的新的位置信息重新确定终端设备的当前位置。In the above method, the method may further include using the terminal device to perform image acquisition on a light tag near the user's current location to determine the position of the terminal device relative to the light tag and send it as new location information to the service provider; The provider re-determines the current location of the terminal device in response to receiving new location information sent from the terminal device.

上述方法中，所述终端设备的位置信息可包括终端设备相对于所采集的光标签的位置和/或终端设备的地理位置。In the above method, the location information of the terminal device may include a location of the terminal device relative to the collected optical tag and / or a geographic location of the terminal device.

在上述方法中，终端设备的地理位置可以是根据所述终端设备相对于光标签的位置以及预先标定的该光标签的地理位置来确定的。In the above method, the geographical position of the terminal device may be determined according to the position of the terminal device relative to the optical label and the geographical position of the optical label that is pre-calibrated.

在上述方法中，在步骤S3)所述终端设备的位置信息可以为终端设备相对于所采集的光标签的位置，以及在步骤S4)还可包括根据接收到的所述终端设备相对于光标签的位置以及预先标定的光标签的地理位置确定所述终端设备的地理位置，以便向其提供所请求的服务。In the above method, the position information of the terminal device in step S3) may be the position of the terminal device relative to the collected optical label, and in step S4) may further include receiving the terminal device relative to the optical label according to the received The location of the terminal and the geographic location of the pre-calibrated light tag determine the geographic location of the terminal device in order to provide it with the requested service.

在又一个实施例中，提供了一种基于光标签的服务提供方法，包括：In another embodiment, a light tag-based service providing method is provided, including:

S2)基于所采集的光标签图像获取与服务提供者相关的信息；S2) Obtaining information related to the service provider based on the collected light tag image;

S3)根据所获取的与服务提供者相关的信息生成服务请求，并将所述服务请求发送给相应的服务提供者；S3) Generate a service request according to the obtained information related to the service provider, and send the service request to the corresponding service provider;

S4)通过所述终端设备对用户周围一个或多个光标签进行图像采集，基于当前采集的图像确定终端设备的当前位置并将其发送给相应的服务提供者；S4) using the terminal device to perform image acquisition on one or more light tags around the user, determine the current position of the terminal device based on the currently acquired image, and send it to the corresponding service provider;

S5)服务提供者基于收到的服务请求和所述当前位置来提供所请求的服务。S5) The service provider provides the requested service based on the received service request and the current location.

在上述方法中，在步骤S4)所述一个或多个光标签可包括与服务提供者关联的光标签或者用户当前位置附近的其他光标签。In the above method, the one or more light tags in step S4) may include a light tag associated with the service provider or other light tags near the current location of the user.

在上述方法中，所述终端设备的当前位置可包括终端设备相对于所采集的光标签的位置和/或终端设备的地理位置。In the above method, the current location of the terminal device may include a location of the terminal device relative to the collected optical tags and / or a geographic location of the terminal device.

在上述方法中，在步骤S4)基于当前采集的图像确定终端设备的当前位置可包括：In the above method, determining the current position of the terminal device based on the currently acquired image in step S4) may include:

识别当前采集的光标签的标识信息；Identifying identification information of the currently collected light tags;

基于所识别的标识信息从预先设定的光标签服务器获取与该光标签相关的地理位置信息；Obtaining geographic location information related to the optical tag from a preset optical tag server based on the identified identification information;

基于当前采集的光标签图像确定所述终端设备相对于该光标签的位置；Determining the position of the terminal device with respect to the light tag based on the currently collected light tag image;

根据所述终端设备相对于该光标签的位置以及所获得的与该光标签相关的地理位置信息确定所述终端设备的地理位置作为该终端设备的当前位置。The geographical position of the terminal device is determined as the current position of the terminal device according to the position of the terminal device relative to the optical label and the obtained geographical position information related to the optical label.

在又一个方面，提供了一种基于光标签的服务提供***，包括在用户携带的终端设备上运行的光标签客户端、与服务提供者关联的光标签和服务器，其中：In yet another aspect, a light label-based service providing system is provided, including a light label client running on a terminal device carried by a user, a light label and a server associated with the service provider, wherein:

所述光标签客户端被配置为：The light label client is configured to:

对与服务提供者关联的光标签进行图像采集；Image collection of light tags associated with service providers;

基于所采集的光标签图像获取与服务提供者相关的信息并确定终端设备相对于光标签的位置；Obtaining information related to the service provider based on the collected light tag image and determining the position of the terminal device relative to the light tag;

根据所获取的与服务提供者相关的信息生成服务请求，并将所述服务请求和所述终端设备相对于光标签的位置发送给相应的服务提供者；Generating a service request according to the obtained information related to the service provider, and sending the service request and the position of the terminal device with respect to the optical tag to the corresponding service provider;

所述服务器被配置为：The server is configured to:

根据收到的终端设备相对于光标签的位置确定终端设备的当前位置；Determining the current position of the terminal device according to the received position of the terminal device relative to the optical tag;

基于收到的服务请求和所述当前位置来提供所请求的服务。The requested service is provided based on the received service request and the current location.

在上述***中，所述光标签客户端还可被配置为：In the above system, the light label client may be further configured as:

对用户当前位置附近的光标签进行图像采集以确定终端设备相对于该光标签的位置并将其作为新位置发送给服务提供者；以及Image collection of a light tag near the user's current location to determine the position of the terminal device relative to the light tag and send it to the service provider as a new location; and

所述服务器还可被配置为：The server may be further configured:

响应于收到自终端设备发送的新位置重新确定终端设备的当前位置。The current location of the terminal device is re-determined in response to receiving the new location sent from the terminal device.

在上述***中，所述服务器还可被配置为：In the above system, the server may be further configured as:

将请求发送给可提供所请求的服务的多个服务提供者；Send requests to multiple service providers who can provide the requested service;

在又一个实施例中，还提供了一种基于光标签的服务提供***，包括在用户携带的终端设备上运行的光标签客户端、与服务提供者关联的光标签和服务器，其中：In another embodiment, a light label-based service providing system is also provided, including a light label client running on a terminal device carried by a user, a light label and a server associated with the service provider, wherein:

所述光标签客户端被配置为：The light label client is configured to:

基于所采集的光标签图像获取与服务提供者相关的信息；Obtaining information related to the service provider based on the collected light tag images;

根据所获取的与服务提供者相关的信息生成服务请求，并将所述服务请求发送给相应的服务提供者；和Generating a service request based on the obtained information related to the service provider, and sending the service request to the corresponding service provider; and

对用户周围一个或多个光标签进行图像采集，基于当前采集的图像确定终端设备的当前位置并将其发送给相应的服务提供者；以及Image collection of one or more light tags around the user, determine the current location of the terminal device based on the currently acquired image and send it to the corresponding service provider; and

所述服务器被配置为：The server is configured to:

在上述***中，所述光标签客户端可基于当前采集的图像确定终端设备的当前位置包括：In the above system, the light tag client may determine the current position of the terminal device based on the currently acquired image including:

本发明还涉及一种计算设备，包括处理器和存储器，所述存储器中存储有计算机程序，所述计算机程序在被所述处理器执行时能够用于实现上述方法。本发明还涉及一种存储介质，其中存储有计算机程序，所述计算机程序在被执行时能够用于实现上述方法。The invention also relates to a computing device comprising a processor and a memory, wherein the computer program is stored in the memory, and the computer program can be used to implement the above method when executed by the processor. The invention also relates to a storage medium in which a computer program is stored, which computer program can be used to implement the above method when executed.

与现有技术相比，本发明的优点在于：提供了高效快捷的服务交互方式，简便了用户购物消费、获得服务的交互过程，能在短时间内给用户及时提供服务，满足其即时产生的服务需求，使其能随时随地享受到实时的服务。Compared with the prior art, the present invention has the advantages that it provides an efficient and efficient service interaction method, simplifies the interactive process for users to purchase and purchase services, and can provide users with services in a short period of time to meet their immediate needs. Service requirements make it possible to enjoy real-time services anytime, anywhere.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

以下参照附图对本发明实施例作进一步说明，其中：The embodiments of the present invention are further described below with reference to the drawings, in which:

图1为CMOS成像器件的示意图；FIG. 1 is a schematic diagram of a CMOS imaging device;

图2为CMOS成像器件获取图像的方向图；FIG. 2 is a directional diagram of an image acquired by a CMOS imaging device; FIG.

图3为根据本发明的一个实施例的光源；3 is a light source according to an embodiment of the present invention;

图4为根据本发明的另一个实施例的光源；4 is a light source according to another embodiment of the present invention;

图5为CMOS成像器件的成像时序图；5 is an imaging timing diagram of a CMOS imaging device;

图6为CMOS成像器件的另一成像时序图；6 is another imaging timing diagram of the CMOS imaging device;

图7示出了当以某一驱动模式驱动光源时在不同阶段在CMOS成像器件上的成像图；7 shows imaging diagrams on a CMOS imaging device at different stages when a light source is driven in a certain driving mode;

图8示出了根据本发明的一个实施例的CMOS成像器件的成像时序图；FIG. 8 shows an imaging timing diagram of a CMOS imaging device according to an embodiment of the present invention; FIG.

图9示出了根据本发明的一个实施例的CMOS成像器件的成像时序图；FIG. 9 shows an imaging timing diagram of a CMOS imaging device according to an embodiment of the present invention; FIG.

图10示出了根据本发明的一个实施例的CMOS成像器件的成像时序图；FIG. 10 illustrates an imaging timing diagram of a CMOS imaging device according to an embodiment of the present invention; FIG.

图11示出了根据本发明的一个实施例的用于实现与图10不同的条纹的CMOS成像器件的成像时序图；FIG. 11 illustrates an imaging timing diagram of a CMOS imaging device for implementing stripes different from those of FIG. 10 according to an embodiment of the present invention; FIG.

图12示出了根据本发明的一个实施例的光标签；FIG. 12 shows an optical label according to an embodiment of the present invention;

图13示出了根据本发明的另一个实施例的光标签；FIG. 13 shows an optical label according to another embodiment of the present invention;

图14示出了根据本发明的一个实施例的CMOS成像器件的成像时序图；FIG. 14 shows an imaging timing diagram of a CMOS imaging device according to an embodiment of the present invention; FIG.

图15示出了以与图14类似的方式控制三个光源而实现的一个实际成像图；FIG. 15 shows an actual imaging diagram achieved by controlling three light sources in a manner similar to FIG. 14;

图16示出了采用不同条纹宽度来实现信息传递的光标签的一个实际成像图；FIG. 16 shows an actual imaging diagram of an optical label using different stripe widths to achieve information transmission; FIG.

图17是根据本发明的一个实施例的包括定位标识的光标签的示意图；17 is a schematic diagram of a light tag including a positioning mark according to an embodiment of the present invention;

图18示出了用肉眼观察时的根据本发明的一个实施例的包括定位标识的光标签；FIG. 18 shows a light tag including a positioning mark according to an embodiment of the present invention when viewed with the naked eye; FIG.

图19为根据本发明实施例的光标签网络的结构示意图；19 is a schematic structural diagram of an optical label network according to an embodiment of the present invention;

图20为三角定位方法的基本原理示意图；FIG. 20 is a schematic diagram of the basic principle of the triangle positioning method;

图21为采集光标签时成像设备的成像过程的原理示意图；21 is a schematic diagram of an imaging process of an imaging device when collecting a light tag;

图22为物坐标系与像坐标系之间的简化关系示意图；22 is a simplified relationship diagram between an object coordinate system and an image coordinate system;

图23为根据本发明实施例的基于光标签的零售方法的流程示意图。FIG. 23 is a schematic flowchart of a light tag-based retail method according to an embodiment of the present invention.

具体实施方式detailed description

为了使本发明的目的，技术方案及优点更加清楚明白，以下结合附图通过具体实施例对本发明进一步详细说明。应当理解，此处所描述的具体实施例仅用以解释本发明，并不用于限定本发明。In order to make the objectives, technical solutions, and advantages of the present invention clearer, the present invention will be further described in detail through specific embodiments with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

在本发明的实施例中采用的光标签可以是能够通过发出不同的光来传输不同的信息的光通信装置，例如在中国专利公开CN104168060A、CN105740936A、专利申请CN201711374915.9、CN201711374042.1、CN201711375274.9等中所描述的光通信装置。在一个实施例中，光标签可包括至少一个光源和控制器，控制器用于控制所述光源发出的不同的光来传递不同的信息。例如，控制器可以通过改变光源发出的光的属性来使得光源发出不同的光。当光源工作时，可以使用成像器件或者具有成像器件的设备(例如手机、平板电脑、智能眼镜等)对光源进行成像，以获得光源的属性变化信息。The optical tags used in the embodiments of the present invention may be optical communication devices capable of transmitting different information by transmitting different light, such as in Chinese Patent Publications CN104168060A, CN105740936A, Patent Applications CN201711374915.9, CN201711374042.1, CN201711375274. 9 and the like. In one embodiment, the light tag may include at least one light source and a controller, and the controller is configured to control different light emitted by the light source to transmit different information. For example, the controller may cause the light source to emit different light by changing the properties of the light emitted by the light source. When the light source is working, the imaging device or a device with the imaging device (such as a mobile phone, tablet computer, smart glasses, etc.) can be used to image the light source to obtain the attribute change information of the light source.

光的属性在本申请中指的是能够被光学成像器件识别的任何光属性，例如其可以是光的强度、颜色、波长等人眼可感知的属性，也可以是人眼不可感知的其他属性，例如在人眼可见范围外的电磁波长的强度、颜色或波长，或者是上述的任一组合。因此，光的属性变化可以是单个属性发生变化，也可以是两个或更多个属性的组合发生变化。当选择光的强度作为属性时，可以简单地通过选择开启或关闭光源实现，也即，在本文中，将不发光作为光的属性变化的一种情形。在下文的一些实施例中为了简单起见，以开启或关闭光源来改变光的属性，但本领域技术人员可以理解，用于改变光的属性的其他方式也是可行的。The attribute of light in this application refers to any light attribute that can be recognized by an optical imaging device, for example, it can be a property that can be perceived by the human eye, such as the intensity, color, and wavelength of light, or other properties that cannot be perceived by the human eye. For example, the intensity, color, or wavelength of electromagnetic wavelengths outside the visible range of the human eye, or any combination thereof. Therefore, a change in the attributes of light may be a change in a single attribute or a combination of two or more attributes. When the intensity of light is selected as an attribute, it can be achieved simply by choosing to turn on or off the light source, that is, in this article, non-emission is considered as a situation where the attribute of light changes. In some embodiments below, for the sake of simplicity, the attributes of light are changed by turning on or off the light source, but those skilled in the art can understand that other ways for changing the attributes of light are also feasible.

在该光标签中可以使用各种形式的光源，只要其某一可被光学成像器件感知的属性能够以不同频率进行变化即可。光源中可以包括各种常见的光学器件，例如导光板、柔光板、漫射器等。例如，光源可以是一个LED灯、由多个LED灯构成的阵列、显示屏幕或者其中的一部分，甚至光的照射区域(例如光在墙壁上的照射区域)也可以作为光源。该光源的形状可以是各种形状，例如圆形、正方形、矩形、条状、L状等。光源中可以包括各种常见的光学器件，例如导光板、柔光板、漫射器等。在一个优选实施例中，光源可以是由多个LED灯构成的二维阵列，该二维阵列的一个维度长于另外一个维度，优选地，两者之间的比例约为6-12：1。例如，该LED灯阵列可以由排成一列的多个LED灯构成。在发光时，该LED灯阵列可以呈现为一个大致为长方形的光源，并由控制器控制该光源的操作。在另一实施例中，光源可以不局限于平面光源，而是可以被实现为一个立体光源，例如，一个条状的圆柱形光源、立方体光源、球形光源等等。该光源例如可以被放置在广场上、悬置于室内场所(例如餐厅、会议室等)的某个位置，从而附近的位于各个方向的用户都可以通过手机拍摄该光源，以获得该光源所传递的信息。Various forms of light sources can be used in the optical label, as long as one of its attributes that can be perceived by the optical imaging device can be changed at different frequencies. The light source may include various common optical devices, such as a light guide plate, a soft light plate, and a diffuser. For example, the light source may be an LED light, an array of a plurality of LED lights, a display screen, or a part thereof, and even a light-irradiated area (such as a light-irradiated area on a wall) may be used as the light source. The shape of the light source may be various shapes, such as a circle, a square, a rectangle, a bar, an L, and the like. The light source may include various common optical devices, such as a light guide plate, a soft light plate, and a diffuser. In a preferred embodiment, the light source may be a two-dimensional array composed of a plurality of LED lamps. One dimension of the two-dimensional array is longer than another dimension. Preferably, the ratio between the two is about 6-12: 1. For example, the LED lamp array may be composed of a plurality of LED lamps arranged in a row. When emitting light, the LED light array can be presented as a substantially rectangular light source, and the operation of the light source is controlled by a controller. In another embodiment, the light source may not be limited to a planar light source, but may be implemented as a three-dimensional light source, for example, a strip-shaped cylindrical light source, a cube light source, a spherical light source, and the like. The light source can be placed, for example, on a square or suspended in an indoor place (such as a restaurant, conference room, etc.), so that users in various directions nearby can photograph the light source through a mobile phone to obtain the light source transmission. Information.

当上述光标签在工作时，控制器可以以一定的频率(例如，30次/秒)改变光标签中的光源的工作模式，从而使得光标签能够连续地向外传递信息。控制器可以控制每个光源发出的光的属性，以便传递信息。例如，可以通过控制每个光源的开启和关闭来表示二进制数字信息的“0”或“1”，从而该光标签中多个光源可以用于表示一个二进制数字信息序列。如本领域技术人员可以理解的，每个光源不仅可以用于表示一个二进制数，还可以用于表示三进制或更大进制的数据。例如，可以通过将光源所发出的光的强度设置为从三种或更多种水平中进行选择，或者通过将光源所发出的光的颜色设置为从三种或更多种颜色中进行选择，甚至通过采用强度与颜色的组合，来使得每个光源能表示三进制或更大进制的数据。控制器可以控制光源以一定频率改变其所发出的光的属性，从而使得光标签可以在不同的时间表示不同的数据信息。这样，当使用光学成像设备对本发明的光标签进行连续拍摄时(例如，以30帧/秒的速率)，其每一帧图像都可以用于表示一组信息序列。When the optical tag is working, the controller may change the working mode of the light source in the optical tag at a certain frequency (for example, 30 times / second), so that the optical tag can continuously transmit information outward. The controller can control the properties of the light emitted by each light source in order to convey information. For example, "0" or "1" of the binary digital information can be represented by controlling the on and off of each light source, so that multiple light sources in the light tag can be used to represent a sequence of binary digital information. As can be understood by those skilled in the art, each light source can be used not only to represent a binary number, but also to represent data in ternary or greater. For example, by setting the intensity of light emitted by a light source to select from three or more levels, or by setting the color of light emitted by a light source to select from three or more colors, Even by using a combination of intensity and color, each light source can represent data in ternary or greater. The controller can control the light source to change the properties of the light it emits at a certain frequency, so that the light tag can represent different data information at different times. In this way, when the optical tag of the present invention is continuously photographed using an optical imaging device (for example, at a rate of 30 frames / second), each frame of the image can be used to represent a set of information sequences.

为了识别光标签传递的信息，可以使用各种光学成像器件(例如，CCD器件、CMOS器件等)对其进行扫描，并获取光标签的一帧或多帧图像，从而识别出光标签在各帧图像被拍摄时所传递的信息。光学成像器件可以集成或设置在诸如手机、平板电脑、智能眼镜之类的终端设备中。例如用户在距离光标签视距范围内通过肉眼发现光标签时，可通过其携带的移动终端中的光学成像器件对光标签进行图像采集，例如扫描该光标签并进行信息捕获与判读处理。当光标签的控制器控制光源以一定频率改变其所发出的光的属性时，移动终端的图像采集频率可以被设置为大于或等于光源的属性变换频率的2倍。通过对所采集的图像帧进行解码操作，可以完成识别解码的过程。在一个实施例中，为了避免图像帧的重复、遗漏等，可以在光标签所传递的信息中包括序列号、校验位、时间戳等。根据需要，可以在多个图像帧中给出起始帧或结束帧，或者二者兼有，用于指示多个图像帧的一个完整周期的开始或结束位置，该起始帧或结束帧可以被设定为显示某个特殊的数据组合，例如：全0或全1，或者任何不会与实际可能显示的信息相同的特殊组合。In order to identify the information transmitted by the optical label, various optical imaging devices (for example, CCD devices, CMOS devices, etc.) can be used to scan it, and one or more frames of the optical label can be acquired to identify the optical label in each frame image. The message passed when being filmed. The optical imaging device can be integrated or provided in a terminal device such as a mobile phone, a tablet computer, or smart glasses. For example, when a user finds a light tag through the naked eye within the visual range of the distance light tag, the user can perform image collection on the light tag through the optical imaging device in the mobile terminal carried by the user, such as scanning the light tag and performing information capture and interpretation processing. When the controller of the light tag controls the light source to change the attributes of the light it emits at a certain frequency, the image acquisition frequency of the mobile terminal may be set to be greater than or equal to 2 times the frequency of the attribute conversion of the light source. By performing a decoding operation on the captured image frames, the process of identifying and decoding can be completed. In one embodiment, in order to avoid repetition, omission, etc. of image frames, the information transmitted by the optical tag may include a serial number, a check digit, a time stamp, and the like. According to requirements, a start frame or an end frame may be given in multiple image frames, or both, to indicate the start or end position of a complete cycle of multiple image frames. The start frame or end frame may be It is set to display a particular combination of data, for example: all 0 or all 1, or any special combination that will not be the same as the information that may actually be displayed.

以CMOS成像器件为例，当通过CMOS成像器件拍摄光源的连续的多帧图像时，可以通过控制器进行控制，使得光源的工作模式之间的切换时间间隔等于CMOS成像器件一个完整帧成像的时间长度，从而实现光源与成像器件的帧同步。假定每个光源每帧传输1比特的信息，那么对于30帧/每秒的拍摄速度，每个光源每秒钟可以传递30比特的信息，编码空间达到2 ³⁰，该信息可以包括例如，起始帧标记(帧头)、光标签的ID、口令、验证码、网址信息、地址信息、时间戳或其不同的组合等等。可以按照结构化方法，设定上述各种信息的顺序关系，形成数据包结构。每接收到一个完整的该数据包结构，视为获得一组完整数据(一个数据包)，进而可以对其进行数据读取和校验分析。表1给出根据本发明的一个实施例的示例数据包结构： Taking a CMOS imaging device as an example, when a continuous multi-frame image of a light source is captured by the CMOS imaging device, it can be controlled by the controller so that the switching time interval between the working modes of the light source is equal to the time of one full frame imaging of the CMOS imaging device Length to achieve frame synchronization between the light source and the imaging device. Assuming that each light source transmits 1 bit of information per frame, for a shooting speed of 30 frames per second, each light source can transmit 30 bits of information per second, and the coding space reaches 2 ^30. This information can include, for example, the start Frame mark (frame header), light tag ID, password, verification code, web address information, address information, timestamp or different combinations thereof, etc. According to the structuring method, the sequence relationship of the above-mentioned various information can be set to form a data packet structure. Each time a complete packet structure is received, it is considered to obtain a complete set of data (a data packet), which can then be read and checked for analysis. Table 1 shows an example data packet structure according to an embodiment of the present invention:

表1Table 1

帧头Frame header

属性字段(可选)Attribute field (optional)

数据字段Data field

校验位Check Digit

帧尾End of frame

目前在电子设备中广泛采用的CMOS成像器件通常使用的是滚动快门成像方式，也即，在一帧图像中的各个像素不是同时曝光的(例如，像素以逐行方式曝光)。本发明有利地利用了滚动快门成像方式的这种非同时曝光特性，从而使得当通过不同的驱动模式驱动光源时，在通过滚动快门成像器件对该光源拍摄时所获得的该光源的图像上能够呈现出各种不同的条纹图案或者无条纹图案。通过对光源图像中的图案的分析识别，可以实现对光通信装置所传递的信息的识别。CMOS imaging devices currently widely used in electronic devices generally use a rolling shutter imaging method, that is, the pixels in a frame of an image are not exposed simultaneously (for example, the pixels are exposed in a progressive manner). The present invention advantageously utilizes such a non-simultaneous exposure characteristic of a rolling shutter imaging mode, so that when a light source is driven by different driving modes, an image of the light source obtained when the light source is captured by the rolling shutter imaging device can be used. Presents a variety of different striped or non-striped patterns. By analyzing and identifying the pattern in the light source image, the information transmitted by the optical communication device can be identified.

图1示出了一个示例的CMOS成像器件，其包括图像传感器(也称为像敏单元)阵列以及一些其他元件。图像传感器阵列中的每一个图像传感器对应于一个像素。每一列图像传感器连接到一个列放大器，列放大器的输出信号之后被送往A/D转换器(ADC)进行模数转换，然后通过接口电路输出。对于图像传感器阵列中的任一图像传感器，在曝光开始时先将其清零，然后等待曝光时间过后，将信号值读出。CMOS成像器件通常采用滚动快门成像方式。在CMOS成像器件中，数据的读出是串行的，所以清零/曝光/读出也只以类似于流水线的方式逐行顺序进行，并在图像传感器阵列的所有行都处理完成后将其合成为一帧图像。因此，整个CMOS图像传感器阵列实际上是逐行曝光的(在某些情况下CMOS图像传感器阵列也可采用每次多行一起曝光的方式)，这导致了各个行之间存在小的时延。由于该小的时延，当光源以一定频率闪烁(例如，通过开启和关闭光源来实现)时，会在CMOS成像器件拍摄的图像上呈现出条纹。FIG. 1 illustrates an example CMOS imaging device including an image sensor (also referred to as an image-sensitive unit) array and some other elements. Each image sensor in the image sensor array corresponds to one pixel. Each column of image sensors is connected to a column amplifier, and the output signal of the column amplifier is then sent to an A / D converter (ADC) for analog-to-digital conversion, and then output through an interface circuit. For any image sensor in the image sensor array, it is cleared at the beginning of the exposure, and then the signal value is read out after the exposure time has elapsed. CMOS imaging devices usually use a rolling shutter imaging method. In CMOS imaging devices, data is read out serially, so zeroing / exposure / reading is only performed line by line in a pipeline-like manner, and it is processed after all rows of the image sensor array are processed. Combined into one frame image. Therefore, the entire CMOS image sensor array is actually exposed line by line (in some cases, the CMOS image sensor array can also be exposed together with multiple lines at a time), which results in a small delay between the lines. Due to this small time delay, when the light source flickers at a certain frequency (for example, by turning the light source on and off), stripes appear on the image captured by the CMOS imaging device.

当光源工作时，可以使用CMOS成像器件或者具有CMOS成像器件的设备(例如手机、平板电脑、智能眼镜等)对光源进行成像，也即，通过滚动快门的方式进行成像。在下文中以手机作为CMOS成像器件为例进行说明，如图2所示。该手机的行扫描方向在图2中示出为垂直方向，但本领域技术人员可以理解，依据底层硬件配置的不同，行扫描方向也可以是水平方向。When the light source is working, a CMOS imaging device or a device with a CMOS imaging device (such as a mobile phone, tablet computer, smart glasses, etc.) can be used to image the light source, that is, imaging can be performed by means of a rolling shutter. The following description uses a mobile phone as a CMOS imaging device as an example, as shown in FIG. 2. The line scanning direction of the mobile phone is shown as a vertical direction in FIG. 2, but those skilled in the art can understand that the line scanning direction may also be a horizontal direction depending on the underlying hardware configuration.

图3示出了根据本发明的一个实施例的光源。在使用CMOS成像器件对图3所示的光源进行成像时，优选地使图3所示的光源的长边与CMOS成像器件的行方向(例如，图2所示的手机的行扫描方向)垂直或大致垂直，以在其他条件相同的情况下成像出尽量多的条纹。然而，有时用户并不了解其手机的行扫描方向，为了保证手机在各种姿态下都能够进行识别，并且在竖屏和横屏下都能够达到最大的识别距离，光源可以为多个长方形的组合，例如，如图4所示的L状光源。Fig. 3 shows a light source according to an embodiment of the invention. When using a CMOS imaging device to image the light source shown in FIG. 3, it is preferable to make the long side of the light source shown in FIG. 3 perpendicular to the row direction of the CMOS imaging device (for example, the line scanning direction of the mobile phone shown in FIG. 2). Or roughly vertical to image as many stripes as possible under the same conditions. However, sometimes users do not know the direction of the line scan of their mobile phones. In order to ensure that the mobile phone can recognize in various postures and achieve the maximum recognition distance in both vertical and horizontal screens, the light source can be multiple rectangular In combination, for example, an L-shaped light source as shown in FIG. 4.

图5示出了CMOS成像器件的成像时序图，其中的每一行对应于CMOS成像器件的一行传感器。在CMOS成像传感器阵列的每一行进行成像时，主要涉及两个阶段，分别为曝光时间和读出时间。各行的曝光时间有可能发生重叠，但读出时间不会重叠。FIG. 5 shows an imaging timing diagram of the CMOS imaging device, where each row corresponds to a row of sensors of the CMOS imaging device. The imaging of each row of the CMOS imaging sensor array mainly involves two stages, namely exposure time and readout time. The exposure time of each line may overlap, but the readout time does not overlap.

需要说明的是，图5中仅示意性地示出了少量的行，在实际的CMOS成像器件中，依赖于分辨率的不同，通常具有上千行传感器。例如，对于1080p分辨率，其具有1920×1080个像素，数字1080表示有1080条扫描行，数字1920表示每行有1920个像素。对于1080p分辨率，每一行的读出时间大致为8.7微秒(即，8.7×10 ^-6秒)。 It should be noted that FIG. 5 only schematically shows a small number of lines. In an actual CMOS imaging device, there are usually thousands of lines of sensors depending on the resolution. For example, for a 1080p resolution, it has 1920 × 1080 pixels, the number 1080 indicates that there are 1080 scan lines, and the number 1920 indicates that each line has 1920 pixels. For 1080p resolution, the readout time for each line is approximately 8.7 microseconds (ie, 8.7 × 10 ^-6 seconds).

如果曝光时间过长导致相邻行之间的曝光时间出现大量重叠，则可能在成像时呈现出明显过渡的条纹，例如，在纯黑色像素行与纯白色像素行之间的多条具有不同灰度的像素行。本发明期望能够呈现出尽量清晰的像素行，为此，可以对CMOS成像器件(例如手机)的每一行的曝光时间进行设置或调整(例如，通过手机上安装的APP来进行设置或调整)，以选择相对较短的曝光时间。在一个优选的实施例中，可以使得曝光时间大致等于或小于每一行的读出时间。以1080p分辨率为例，其每一行的读出时间大致为8.7微秒，在这种情况下，可以考虑将手机的曝光时间调整为大约8.7微秒或更短。图6示出了在这种情况下的CMOS成像器件的成像时序图。在这种情况下，每行的曝光时间基本不发生重叠，或者重叠部分较少，从而可以在成像时获得具有比较清晰的边界的条纹，其更容易被识别出来。需要说明的是，图6仅仅是本发明的一个优选实施例，更长的(例如等于或小于每一行的读出时间的两倍、三倍或四倍等)或更短的曝光时间也是可行的。例如，每一行的读出时间可以大致为8.7微秒，而所设置的每行曝光时长为14微秒。另外，为了呈现出条纹，优选地可以将光源的驱动模式的信号的一个周期的时长设置为曝光时长的两倍左右或更长。If the exposure time is too long and there is a lot of overlap in the exposure time between adjacent rows, there may be obvious transitional streaks during imaging, for example, multiple lines between pure black pixel rows and pure white pixel rows have different gray Degrees of pixel rows. The present invention expects to be able to present pixel lines that are as clear as possible. To this end, the exposure time of each line of the CMOS imaging device (such as a mobile phone) can be set or adjusted (for example, set or adjusted by an APP installed on the mobile phone), To choose a relatively short exposure time. In a preferred embodiment, the exposure time can be made substantially equal to or less than the readout time of each line. Taking 1080p resolution as an example, the readout time of each line is approximately 8.7 microseconds. In this case, you can consider adjusting the exposure time of the mobile phone to about 8.7 microseconds or less. FIG. 6 shows an imaging timing chart of the CMOS imaging device in this case. In this case, the exposure time of each line basically does not overlap, or there is less overlap, so that stripes with relatively clear boundaries can be obtained during imaging, which is easier to identify. It should be noted that FIG. 6 is only a preferred embodiment of the present invention, and a longer (for example, equal to or less than twice, three times, or four times the reading time of each row) or shorter exposure time is also feasible. of. For example, the readout time of each line can be approximately 8.7 microseconds, and the exposure time of each line can be set to 14 microseconds. In addition, in order to exhibit streaks, it is preferable to set the duration of one cycle of the signal of the driving mode of the light source to about twice the exposure duration or longer.

图7示出了当控制器在某一驱动模式下以一定频率开启和关闭光源时在不同阶段在CMOS成像器件上的成像图。具体地，图7的上部示出了在不同阶段的光源的状态变化图(白色对应于光源开启，黑色对应于光源关闭)，下部示出了在不同阶段该光源在CMOS成像器件上的成像图，其中，CMOS成像器件的行方向为垂直方向，并从左向右扫描。由于CMOS成像器件采集图像是逐行扫描的，因此在拍摄高频闪烁信号时，所获得的一帧图像上与光源的成像位置对应的部分会形成如图7下部所示的条纹，具体地，在时段1，光源开启，在该时段中曝光的最左侧部分的扫描行呈现亮条纹；在时段2，光源关闭，在该时段中曝光的扫描行呈现暗条纹；在时段3，光源开启，在该时段中曝光的扫描行呈现亮条纹；在时段4，光源关闭，在该时段中曝光的扫描行呈现暗条纹。FIG. 7 shows imaging diagrams on the CMOS imaging device at different stages when the controller turns on and off the light source at a certain frequency in a certain driving mode. Specifically, the upper part of FIG. 7 shows the state change diagram of the light source at different stages (white corresponds to the light source being turned on and black corresponds to the light source being turned off), and the lower part shows the imaging diagram of the light source on the CMOS imaging device at different stages. Among them, the row direction of the CMOS imaging device is vertical, and scans from left to right. Because the CMOS imaging device captures images progressively, when capturing high-frequency flicker signals, the part of the obtained frame corresponding to the imaging position of the light source will form stripes as shown in the lower part of FIG. 7, specifically, In period 1, the light source is turned on, and the scanning line of the leftmost part of the exposure during this period shows bright stripes; in period 2, the light source is turned off, and the scanning line exposed in this period shows dark stripes; in period 3, the light source is turned on, The scanning lines exposed during this period show bright stripes; during period 4, the light source is turned off, and the scanning lines exposed during this period show dark stripes.

控制器可以通过驱动模式来设置光源闪烁的频率，或者设置光源每次开启和关闭的时长，从而调整出现的条纹的宽度。更长的开启或关闭时间通常对应于更宽的条纹。例如，对于图6所示的情形，如果将光源每次开启和关闭的时长均设置为大致等于CMOS成像器件的每一行的曝光时间(该曝光时间可以通过手机上安装的APP进行设置或者手工设置)，则可以在成像时呈现出宽度为仅一个像素的条纹。如果将光源每次开启或关闭的时长均设置为大致等于CMOS成像器件的每一行的曝光时长的大约2倍，可以实现宽度为大约两个像素的条纹，具体如图8所示，其中，图8的上部示出了光源的驱动模式的信号波形，其高电平可以对应于光源的开启，而低电平可以对应于光源的关闭。图8的驱动模式的信号频率例如可以是每秒16000次(每个周期的持续时间为62.5微秒，其中开启时长和关闭时长各为大约31.25微秒)。在图8所示的实施例中，将驱动模式的信号的占空比设置为大约50％，将每一行的曝光时长设置为大致等于每一行的读出时间，但本领域技术人员可以理解，其他设置也是可行的，只要能够呈现出可分辨的条纹即可。为了描述简单起见，图8中使用了光源与CMOS成像器件之间的同步，以使得光源的开启和关闭的时间大致对应于CMOS成像器件的某一行的曝光时长的开始或结束时间，但是本领域技术人员可以理解，即使两者未能如图8那样同步，也可以在CMOS成像器件上呈现出明显的条纹，此时，可能会存在一些过渡条纹，但一定存在光源始终关闭时曝光的行(也即最暗的条纹)与光源始终开启时曝光的行(也即最亮的条纹)，两者间隔一个像素。这种像素行的明暗变化(也即条纹)可以被容易地检测出来(例如，通过比较光源成像区域中的一些像素的亮度或灰度)。更进一步，即使不存在光源始终关闭时曝光的行(也即最暗的条纹)和光源始终开启时曝光的行(也即最亮的条纹)，如果存在曝光时间内光源开启部分t1小于一定时间长度或占整个曝光时长较小比例的行(也即较暗条纹)，和曝光时间内光源开启部分t2大于一定时间长度或占整个曝光时长较大比例的行(也即较亮条纹)，且t2-t1>明暗条纹差值阈值(例如10微秒)，或t2/t1>明暗条纹比例阈值(例如2)，这些像素行之间的明暗变化也可以被检测出来。上述明暗条纹差值阈值和比例阈值和光标签发光强度、感光器件属性、拍摄距离等相关。本领域技术人员可以理解，其他阈值也是可行的，只要能够呈现出计算机可分辨的条纹图案即可。The controller can set the flashing frequency of the light source through the driving mode, or set the length of each time the light source is turned on and off, so as to adjust the width of the appearing stripes. Longer on or off times usually correspond to wider stripes. For example, for the situation shown in FIG. 6, if the length of each time the light source is turned on and off is set to approximately equal to the exposure time of each row of the CMOS imaging device (the exposure time can be set through the APP installed on the mobile phone or manually set ), Stripes with a width of only one pixel can be displayed during imaging. If the length of each time the light source is turned on or off is set to approximately equal to about 2 times the exposure time of each line of the CMOS imaging device, a stripe with a width of about two pixels can be realized, as shown in FIG. 8, where The upper part of 8 shows the signal waveform of the driving mode of the light source, the high level of which can correspond to the turning on of the light source, and the low level can correspond to the turning off of the light source. The signal frequency of the driving mode in FIG. 8 may be, for example, 16,000 times per second (the duration of each cycle is 62.5 microseconds, where the on-time and off-time are each about 31.25 microseconds). In the embodiment shown in FIG. 8, the duty cycle of the signal of the driving mode is set to about 50%, and the exposure time of each line is set to be approximately equal to the readout time of each line, but those skilled in the art can understand that Other settings are possible, as long as they can show distinguishable stripes. For simplicity of description, the synchronization between the light source and the CMOS imaging device is used in FIG. 8 so that the time when the light source is turned on and off roughly corresponds to the start or end time of the exposure duration of a certain row of the CMOS imaging device. The skilled person can understand that even if the two are not synchronized as shown in FIG. 8, obvious streaks may appear on the CMOS imaging device. At this time, there may be some transitional streaks, but there must be lines exposed when the light source is always turned off ( That is, the darkest stripe) and the line that is exposed when the light source is always on (that is, the brightest stripe) are separated by one pixel. Such a change in lightness and darkness (ie, stripes) of a pixel row can be easily detected (for example, by comparing the brightness or grayscale of some pixels in the imaging region of the light source). Furthermore, even if there are no lines exposed when the light source is always off (that is, the darkest streaks) and lines exposed when the light source is always on (that is, the brightest streaks), if there is a light source on portion t1 that is less than a certain time during the exposure time The length of the line or a small proportion of the entire exposure time (that is, darker stripes), and the light source on part t2 during the exposure time is greater than a certain length of time or the line of the entire exposure time (that is, lighter stripes), and t2-t1> light and dark fringe difference threshold (for example, 10 microseconds), or t2 / t1> light and dark fringe ratio threshold (for example, 2), light and dark changes between these pixel rows can also be detected. The above-mentioned light-dark fringe difference threshold and proportional threshold are related to the light label light-emitting intensity, light-sensitive device attributes, and shooting distance. Those skilled in the art can understand that other thresholds are also feasible, as long as they can display a computer-recognizable stripe pattern.

根据本发明的一个实施例的条纹图案识别方法如下：得到光标签的图像，利用投影的方式分割出光源的成像区域；收集不同配置下(例如，不同距离、不同的光源闪烁频率等)的有条纹图片和无条纹图片；将所有收集的图片统一归一化到一个特定大小，例如64*16像素；提取每一个像素特征(例如亮度、颜色等)作为输入特征，构建机器学习分类器；进行二分类判别以判断是条纹图片还是非条纹图片。对于条纹识别，本领域普通技术人员还可以采用本领域公知的任何其他方法进行处理，对此不再详述。A method for identifying a stripe pattern according to an embodiment of the present invention is as follows: obtaining an image of a light tag, and dividing the imaging area of the light source by projection; collecting different configurations (for example, different distances, different flicker frequencies of the light source, etc.) Striped and non-striped pictures; normalize all collected pictures to a specific size, such as 64 * 16 pixels; extract each pixel feature (such as brightness, color, etc.) as input features to build a machine learning classifier; perform Binary classification is used to determine whether it is a striped picture or a non-striped picture. For the fringe recognition, a person of ordinary skill in the art may also use any other method known in the art for processing, which will not be described in detail.

对于一个长度为5厘米的条状光源，当使用目前市场上常见的手机，设置分辨率为1080p，在距离其10米远的地方(也即，距离为光源长度的200倍)进行拍摄时，该条状光源在其长度方向上大约会占据6个像素，如果每个条纹宽度为2个像素，则在该6个像素的宽度范围内会呈现出至少一个明显的条纹，其可以被很容易地识别出来。如果设置更高的分辨率，或者采用光学变焦，在更远的距离，例如距离为光源长度的300倍或400倍时，也能够识别出条纹。For a strip-shaped light source with a length of 5 cm, when using a common mobile phone currently on the market with a resolution of 1080p and shooting at a distance of 10 meters (that is, 200 times the length of the light source), The strip-shaped light source will occupy about 6 pixels in its length direction. If each stripe width is 2 pixels, at least one obvious stripe will be displayed within the width of the 6 pixels, which can be easily To recognize it. If a higher resolution is set or an optical zoom is used, streaks can also be recognized at longer distances, such as when the distance is 300 or 400 times the length of the light source.

控制器也可以通过不同的驱动模式来驱动光源，以便例如以另一频率来开启和关闭光源。对于图6所示的情形，可以将光源配置为在CMOS成像器件的每一行的曝光时间内光源开启和关闭至少一次，例如每秒64000次或更高。图9示出了在每一行的曝光时间内光源开启和关闭只一次的情形，其中，图9的上部示出了光源的驱动模式的信号波形，其高电平可以对应于光源的开启，而低电平可以对应于光源的关闭。由于在每一行的曝光时间内，光源都会以相同的方式开启和关闭一次，每个曝光时间获取的曝光强度能量大致均等，因此光源的最终成像的各个像素行之间的亮度不会存在明显差异，从而不存在条纹。本领域技术人员可以理解，更高的开启和关闭频率也是可行的。另外，为了描述简单起见，图9中使用了光源与CMOS成像器件之间的同步，以使得光源的开启时间大致对应于CMOS成像器件的某一行的曝光时长的开始时间，但是本领域技术人员可以理解，即使两者未能如图9那样同步，在光源的最终成像的各个像素行之间的亮度也不会存在明显差异，从而不存在条纹。The controller may also drive the light source through different driving modes, for example to turn the light source on and off at another frequency. For the situation shown in FIG. 6, the light source may be configured to be turned on and off at least once during the exposure time of each row of the CMOS imaging device, such as 64,000 times per second or higher. FIG. 9 shows a situation in which the light source is turned on and off only once during the exposure time of each row, wherein the upper part of FIG. 9 shows the signal waveform of the driving mode of the light source, and its high level may correspond to the on of the light source, and Low level may correspond to the turning off of the light source. Since the light source is turned on and off in the same way during the exposure time of each line, the exposure intensity energy obtained by each exposure time is approximately equal, so there will be no significant difference in brightness between the individual pixel rows of the light source's final imaging So that there are no streaks. Those skilled in the art can understand that higher opening and closing frequencies are also feasible. In addition, for simplicity of description, the synchronization between the light source and the CMOS imaging device is used in FIG. 9 so that the turn-on time of the light source roughly corresponds to the start time of the exposure duration of a certain row of the CMOS imaging device, but those skilled in the art can It is understood that even if the two are not synchronized as shown in FIG. 9, there will be no significant difference in brightness between the respective pixel rows of the final imaging of the light source, so that there are no stripes.

在另一实施例中，当不希望呈现条纹时，也可以向光源提供直流电，以使得光源发出强度基本不变的光，从而，在通过CMOS图像传感器对光源拍摄时所获得的该光源的一帧图像上不会呈现条纹。在这种情况下，也可以实现在不同驱动模式下的大致相同的光通量，以避免在不同驱动模式之间切换时人眼可能会察觉到的闪烁现象。另外，可以理解，当本发明的光源持续工作于某一驱动模式下时，人眼也不会察觉到任何闪烁现象。In another embodiment, when streaks are not desired, a direct current may also be provided to the light source, so that the light source emits light having a substantially constant intensity. Thus, one of the light sources obtained when the light source is photographed by the CMOS image sensor is used. No streaks appear on the frame image. In this case, approximately the same luminous flux can be achieved in different driving modes to avoid flickering that human eyes may notice when switching between different driving modes. In addition, it can be understood that when the light source of the present invention continues to work in a certain driving mode, the human eye does not perceive any flicker phenomenon.

上文的图8描述了通过使光源发出的光的强度发生变化(例如，通过开启或关闭光源)来呈现条纹的实施例，在另一实施例中，如图10所示，也可以通过使光源发出不同波长或颜色的光来呈现条纹。在图10所示的实施例中，光源中包括可发出红光的红色灯和可发出蓝光的蓝色灯。图10的上部示出了光源驱动模式的信号，其包括红光驱动信号和蓝光驱动信号，其中，高电平对应于相应光源的开启，而低电平对应于相应光源的关闭。该红光驱动信号和蓝光驱动信号的相位偏移180°，也即，两者电平相反。通过红光驱动信号和蓝光驱动信号，可以使得光源向外交替地发出红色光和蓝色光，从而当采用CMOS成像器件对光源进行成像时可以呈现出红蓝条纹。FIG. 8 above describes an embodiment in which stripes are displayed by changing the intensity of light emitted by a light source (for example, by turning the light source on or off). In another embodiment, as shown in FIG. Light sources emit light of different wavelengths or colors to show stripes. In the embodiment shown in FIG. 10, the light source includes a red lamp capable of emitting red light and a blue lamp capable of emitting blue light. The upper part of FIG. 10 shows the signal of the light source driving mode, which includes a red light driving signal and a blue light driving signal, wherein a high level corresponds to the on of the corresponding light source and a low level corresponds to the off of the corresponding light source. The phase of the red light driving signal and the blue light driving signal is shifted by 180 °, that is, the levels of the two are opposite. The red light driving signal and the blue light driving signal can cause the light source to alternately emit red light and blue light outward, so that when a CMOS imaging device is used to image the light source, red and blue stripes can appear.

在一个实施例中，可以基于光源驱动模式的不同信号频率来实现不同宽度的条纹，例如，在第一驱动模式下，光源可以如图8所示的方式工作，从而实现宽度为大约两个像素的第一种条纹；在第二驱动模式下，可以将图8中的光源驱动模式的信号的每个周期中的高电平和低电平的持续时间分别修改为原来的两倍，例如，LED灯闪烁频率可以被设置每秒8000次(每个周期的持续时间为125微秒，其中开启时长和关闭时长各为大约62.5微秒)，从而实现宽度为大约四个像素的第二种条纹，具体如图11所示。In one embodiment, stripes of different widths can be implemented based on different signal frequencies of the light source driving mode. For example, in the first driving mode, the light source can work as shown in FIG. 8 to achieve a width of about two pixels. In the second driving mode, the duration of the high level and the low level in each cycle of the signal of the light source driving mode in FIG. 8 can be modified to twice the original, for example, LED The flashing frequency of the lamp can be set to 8000 times per second (the duration of each cycle is 125 microseconds, where the on-time and off-time are each about 62.5 microseconds) to achieve a second stripe with a width of about four pixels. The details are shown in FIG. 11.

在另一个实施例中，可以实现不同颜色的条纹，例如，可以将光源设置为其中包括可发出红光的红色灯和可发出蓝光的蓝色灯，在第一驱动模式下，可以关闭蓝色灯，并使红色灯如图8所示的方式工作，从而实现红黑条纹；在第二驱动模式下，可以关闭红色灯，并使蓝色灯如图8所示的方式工作，从而实现蓝黑条纹。在上述实施例中，在第一驱动模式和第二驱动模式下使用相同的信号频率实现了红黑条纹和蓝黑条纹，但是可以理解，在第一驱动模式和第二驱动模式下可以使用不同的信号频率。In another embodiment, stripes of different colors may be implemented. For example, the light source may be set to include a red light that emits red light and a blue light that emits blue light. In the first driving mode, blue may be turned off. In the second driving mode, the red lamp can be turned off, and the blue lamp can work in the manner shown in FIG. 8 to achieve blue. Black stripes. In the above embodiment, the red and black stripes and the blue and black stripes are realized using the same signal frequency in the first driving mode and the second driving mode, but it can be understood that different values can be used in the first driving mode and the second driving mode. Signal frequency.

另外，本领域技术人员可以理解，可以进一步地实现不止两种条纹，例如，在上述光源中包括红色灯和蓝色灯的实施例中，可以进一步设置第三驱动模式，在该第三驱动模式下以图10所示的方式对红色灯和蓝色灯进行控制以实现红蓝条纹。显然，可选地，也可以进一步实现无条纹的图案。In addition, those skilled in the art can understand that more than two kinds of stripes can be further implemented. For example, in the embodiment in which the light source includes a red lamp and a blue lamp, a third driving mode may be further set. In this third driving mode, The red and blue lights are controlled in the manner shown in FIG. 10 to achieve red and blue stripes. Obviously, optionally, a streak-free pattern can be further realized.

控制器可以随着时间的过去根据待传输的信息不断地通过相应的驱动模式来驱动光源(例如，以30次/秒的频率设置光源的驱动模式，也即，每经过1/30秒，根据待传输的信息来设置光源的驱动模式)，使得该光源能够连续地向外传递信息。为了识别光源传递的信息，可以使用CMOS成像器件对其进行扫描，并获取光源的一帧或多帧图像，从而通过光源在各帧图像上所呈现的不同图案(例如，无条纹图案和各种各样的条纹图案)，识别出光源在各帧图像被拍摄时所传递的信息。The controller can continuously drive the light source through the corresponding driving mode according to the information to be transmitted over time (for example, the driving mode of the light source is set at a frequency of 30 times / second, that is, every 1/30 second, according to The information to be transmitted sets the driving mode of the light source), so that the light source can continuously transmit information to the outside. In order to identify the information transmitted by the light source, it can be scanned with a CMOS imaging device, and one or more frames of the light source can be acquired, so that different patterns (for example, non-striped patterns and various Various stripe patterns) to identify the information transmitted by the light source when each frame of image is captured.

在上文中，为了方便说明，以方波为例描述了具有相应信号频率的驱动模式，但本领域技术人员可以理解，驱动模式中也可以使用信号的其他波形，例如正弦波、三角波等。In the foregoing, for convenience of explanation, a square wave is used as an example to describe a driving mode with a corresponding signal frequency, but those skilled in the art can understand that other waveforms of a signal, such as a sine wave, a triangle wave, etc. may be used in the driving mode.

在实际的应用环境中，光源在发光时会受到环境光照条件、干扰、噪声等各方面的影响，这可能会影响对光源所传递的信息的识别。因此，为了提高识别的准确度，本发明在光标签中使得一对光源互为参考并配合使用，来一起传递信息。这是非常有利的，因为光标签中的光源位于大致相同的位置，且经受相同的环境光照条件、干扰、噪声等，因此通过比较一对光源的成像，而不是单独地分析某个光源的成像，可以改善对光源所传递的信息的识别的准确性和稳定性，特别适合于复杂环境下的远距离识别。例如，当需要传递第一信息时，控制器可以将两个光源的驱动模式设置为相同从而使得在使用滚动快门成像器件拍摄时它们能呈现出相同的图案(例如，相同的条纹)；当需要传递与第一信息不同的其他信息时，控制器可以将两个光源的驱动模式设置为不同从而使得在使用滚动快门成像器件拍摄时它们能呈现出不同的图案(例如，不同的条纹)。在本文中，不同的图案可以是宽度不同的条纹，也可以是宽度相同但位置不同的条纹(由于光源的驱动模式的不同相位所导致，下文中将会详细说明)，或者可以是在宽度、位置、颜色和亮度中的至少一项上存在区别的条纹。In an actual application environment, when the light source emits light, it will be affected by various aspects such as ambient lighting conditions, interference, and noise, which may affect the identification of the information transmitted by the light source. Therefore, in order to improve the accuracy of recognition, the present invention makes a pair of light sources reference each other in the optical tag and cooperates with each other to transmit information together. This is very advantageous because the light sources in the light tag are located at approximately the same location and experience the same ambient lighting conditions, interference, noise, etc., so by comparing the imaging of a pair of light sources instead of analyzing the imaging of a single light source individually , Can improve the accuracy and stability of the identification of the information transmitted by the light source, and is particularly suitable for long-distance identification in complex environments. For example, when the first information needs to be transmitted, the controller can set the driving modes of the two light sources to be the same so that they can show the same pattern (for example, the same stripes) when shooting with a rolling shutter imaging device; When transmitting other information different from the first information, the controller may set the driving modes of the two light sources to be different so that they can present different patterns (for example, different stripes) when shooting with a rolling shutter imaging device. In this article, different patterns can be stripes with different widths, or stripes with the same width but different positions (due to different phases of the driving mode of the light source, which will be described in detail below), or can be in width, There are different stripes on at least one of position, color, and brightness.

图12示出了根据本发明的一个实施例的包括了两个光源(分别是第一光源101和第二光源102)的光标签100(也称为光通信装置)。光标签100还包括控制器，其用于通过驱动模式来驱动第一光源101和第二光源102。该控制器可以与光源一起集成在一个壳体中，也可以远离光源，只要其能够控制光源的驱动模式即可。为了简明起见，图12中未示出光标签100中的控制器。FIG. 12 illustrates an optical tag 100 (also referred to as an optical communication device) including two light sources (a first light source 101 and a second light source 102, respectively) according to an embodiment of the present invention. The light tag 100 further includes a controller for driving the first light source 101 and the second light source 102 through a driving mode. The controller can be integrated in a housing together with the light source, or it can be remote from the light source, as long as it can control the driving mode of the light source. For simplicity, the controller in the optical tag 100 is not shown in FIG. 12.

在一个实施例中，控制器可以通过使用第一驱动模式来驱动光源，也可以通过使用第二驱动模式来驱动光源，其中，第一驱动模式和第二驱动模式可以具有相同或不同的频率。如果在某一时刻以相同的驱动模式驱动第一光源101和第二光源102，则可以用于向外传递第一信息，例如二进制数据0；如果在某一时刻以不同的驱动模式驱动第一光源101和第二光源102，则可以用于向外传递与第一信息不同的第二信息，例如二进制数据1。在一个实施例中，为了简便，可以始终使用同一种驱动模式来驱动第一光源101和第二光源102中的一个。In one embodiment, the controller may drive the light source by using the first driving mode, and may also drive the light source by using the second driving mode, wherein the first driving mode and the second driving mode may have the same or different frequencies. If the first light source 101 and the second light source 102 are driven in the same driving mode at a certain time, it can be used to transfer the first information, such as binary data 0; if the first driving is driven in a different driving mode at a certain time The light source 101 and the second light source 102 may be used to transmit second information different from the first information, such as binary data 1. In one embodiment, for simplicity, one of the first light source 101 and the second light source 102 can always be driven using the same driving mode.

在一个实施例中，当以不同的驱动模式驱动第一光源101和第二光源102时，可以进一步根据二者具体的驱动模式来传递不同的信息。例如，当以第一驱动模式驱动第一光源101并以第二驱动模式驱动第二光源102时，可以向外传递第二信息，而当以第二驱动模式驱动第一光源101并以第一驱动模式驱动第二光源102时，可以向外传递第三信息。In one embodiment, when the first light source 101 and the second light source 102 are driven in different driving modes, different information may be further transmitted according to the specific driving modes of the two. For example, when the first light source 101 is driven in the first driving mode and the second light source 102 is driven in the second driving mode, the second information may be transmitted outward, and when the first light source 101 is driven in the second driving mode and is driven in the first When the driving mode drives the second light source 102, the third information can be transmitted to the outside.

在一个实施例中，控制器可以通过多于两种驱动模式来驱动第一光源101和第二光源102，以提高编码密度。例如，控制器可以以第一驱动模式、第二驱动模式和第三驱动模式来驱动第一光源101和第二光源102。在这种情况下，当以不同的驱动模式驱动第一光源101和第二光源102时，可以根据二者具体的驱动模式来传递更多的不同信息。例如，当以第一驱动模式驱动第一光源101并以第二驱动模式驱动第二光源102时传递的信息可以不同于当以第一驱动模式驱动第一光源101并以第三驱动模式驱动第二光源102时传递的信息。In one embodiment, the controller may drive the first light source 101 and the second light source 102 through more than two driving modes to improve the coding density. For example, the controller may drive the first light source 101 and the second light source 102 in a first driving mode, a second driving mode, and a third driving mode. In this case, when the first light source 101 and the second light source 102 are driven in different driving modes, more different information can be transmitted according to the specific driving modes of the two. For example, the information transmitted when the first light source 101 is driven in the first driving mode and the second light source 102 is driven in the second driving mode may be different from when the first light source 101 is driven in the first driving mode and the first light source is driven in the third driving mode. The information transmitted by the two light sources 102.

为了提高编码密度，光标签中可以具有三个或更多个光源。图13示出了根据本发明的一个实施例的包括了三个光源(分别是第一光源201、第二光源202和第三光源203)的光标签200。在该实施例中，控制器可以通过第一驱动模式和第二驱动模式来驱动光源，并可以相应地确定出两对光源，例如分别是：第一光源201与第二光源202；以及第二光源202与第三光源203。对于这两对光源中的任一对，都可以根据是否以同一驱动模式来驱动这对光源来传递不同的信息。在一个实施例中，为了简便，可以始终使用同一种驱动模式来驱动两对光源中共有的第二光源202。In order to increase the coding density, the optical tag may have three or more light sources. FIG. 13 illustrates a light tag 200 including three light sources (a first light source 201, a second light source 202, and a third light source 203, respectively) according to an embodiment of the present invention. In this embodiment, the controller may drive the light source through the first driving mode and the second driving mode, and may determine two pairs of light sources accordingly, for example: the first light source 201 and the second light source 202; and the second The light source 202 and the third light source 203. For any of the two pairs of light sources, different information can be transmitted according to whether the pair of light sources are driven in the same driving mode. In one embodiment, for simplicity, the same driving mode can always be used to drive the second light source 202 that is common to the two pairs of light sources.

在一个实施例中，控制器可以以具有第一频率和第一相位的第一驱动模式来控制光源的开启和关闭，并且也可以以第二驱动模式来控制光源的开启和关闭，该第二驱动模式可以具有相同的第一频率以及与第一相位不同的第二相位。第一频率优选地可以是15Hz到32KHz之间的某一个频率，例如，15Hz、30Hz、50Hz、60Hz、80Hz、100Hz、200Hz、500Hz、1KHz、2KHz、4KHz、6KHz、8KHz、12KHz、16KHz、32KHz等。优选地，第一相位和第二相位的相位差是180°(也即，两者反相)。In one embodiment, the controller may control the light source to be turned on and off in a first driving mode having a first frequency and a first phase, and may also be used to control the light source to be turned on and off in a second driving mode. The driving modes may have the same first frequency and a second phase different from the first phase. The first frequency may be a frequency between 15Hz and 32KHz, for example, 15Hz, 30Hz, 50Hz, 60Hz, 80Hz, 100Hz, 200Hz, 500Hz, 1KHz, 2KHz, 4KHz, 6KHz, 8KHz, 12KHz, 16KHz, 32KHz Wait. Preferably, the phase difference between the first phase and the second phase is 180 ° (ie, the two are in opposite phases).

图14示出了针对图13所示的光标签的CMOS成像器件的一个成像时序图。在图14的上部示出了三个光源各自的驱动模式的信号，在本实施例中它们可以(但并非必须)具有相同的幅度，其中高电平例如可以对应于光源的开启，而低电平可以对应于光源的关闭，但本领域技术人员可以理解，高电平和低电平也可以对应于光源的亮度，也即，通过信号的幅值变化来控制光源的亮度变化，而非开启和关闭光源。FIG. 14 shows an imaging timing diagram of the CMOS imaging device for the optical tag shown in FIG. 13. The signals of the respective driving modes of the three light sources are shown in the upper part of FIG. 14. In this embodiment, they may (but need not) have the same amplitude. The high level may correspond to the turning on of the light source, and the low power The level can correspond to the turning off of the light source, but those skilled in the art can understand that the high level and the low level can also correspond to the brightness of the light source, that is, to control the brightness change of the light source by changing the amplitude of the signal, instead of turning on Turn off the light source.

在图14中，第一光源和第二光源此时用于传递第一信息，因此控制器通过相同的驱动模式(例如，均为第一驱动模式或第二驱动模式)来驱动第一光源和第二光源；第二光源和第三光源此时用于传递第二信息，因此控制器通过频率相同但相位相差180°的两个驱动模式来驱动第二光源和第三光源(例如，一个为第一驱动模式，另一个为第二驱动模式)。以此方式，当使用CMOS成像器件对该光标签进行成像时，第一光源、第二光源和第三光源的成像上都会呈现出宽度相同的条纹，但是第一光源与第二光源的成像上的条纹的位置或相位是一致的(也即，第一光源的亮条纹所在的行与第二光源的亮条纹所在的行是一致的，第一光源的暗条纹所在的行与第二光源的暗条纹所在的行是一致的)，而第二光源与第三光源的成像上的条纹的位置或相位是反相的(也即，第二光源的亮条纹所在的行与第三光源的暗条纹所在的行是一致的，第二光源的暗条纹所在的行与第三光源的亮条纹所在的行是一致的)。In FIG. 14, the first light source and the second light source are used to transmit the first information at this time, so the controller drives the first light source and the first light source through the same driving mode (for example, both the first driving mode or the second driving mode). The second light source; the second light source and the third light source are used to transmit the second information at this time, so the controller drives the second light source and the third light source through two driving modes with the same frequency but a phase difference of 180 ° (for example, one is (The first driving mode, the other is the second driving mode). In this way, when the optical label is imaged using a CMOS imaging device, the first light source, the second light source, and the third light source all have the same width stripes on the imaging, but the first light source and the second light source are imaged. The positions or phases of the stripes are consistent (that is, the line where the bright stripes of the first light source are located is the same as the line where the bright stripes of the second light source are located, and the line where the dark stripes of the first light source are located is the same as that of the second light source The lines of the dark stripes are consistent), and the positions or phases of the stripes on the imaging of the second light source and the third light source are reversed (that is, the lines of the light stripes of the second light source are darker than those of the third light source) The lines where the stripes are located are consistent, and the lines where the dark stripes of the second light source are located are the same as the lines where the light stripes of the third light source are located).

图15示出了以与图14类似的方式控制三个光源而实现的一个实际成像图。图15的顶部的条纹图案是第一光源的成像；中间的条纹图案是第二光源的成像；底部的条纹图案是第三光源的成像。CMOS成像器件的行扫描方向在此是竖直方向。如图15所示，三个光源的条纹图案的条纹宽度是相同的，但是，第一光源与第二光源的成像上的条纹的位置或相位是一致的，而第二光源与第三光源的成像上的条纹的位置或相位是反相的(也即，在行扫描方向上，第二光源的亮条纹和暗条纹分别对应于第三光源的暗条纹和亮条纹)。FIG. 15 shows an actual imaging diagram realized by controlling three light sources in a similar manner to FIG. 14. The stripe pattern at the top of FIG. 15 is the imaging of the first light source; the stripe pattern at the middle is the imaging of the second light source; the stripe pattern at the bottom is the imaging of the third light source. The row scanning direction of the CMOS imaging device is a vertical direction here. As shown in FIG. 15, the stripe widths of the stripe patterns of the three light sources are the same. However, the positions or phases of the stripe on the imaging of the first light source and the second light source are the same, and that of the second light source and the third light source are the same. The positions or phases of the stripes on the imaging are reversed (ie, in the row scanning direction, the light and dark stripes of the second light source correspond to the dark and bright stripes of the third light source, respectively).

在通过CMOS成像器件获得了图15所示的实际成像图之后，可以对其进行识别解码。在一个实施例中，可以从该实际成像图中分别截取出与每个光源对应的长条状成像区域，并对它们做竖直方向(也即CMOS成像器件的行扫描方向)的投影,得到三个投影向量：feature_vector[1],feature_vector[2],feature_vector[3]；分别计算feature_vector[1]与feature_vector[2]以及feature_vector[2]与feature_vector[3]的相关系数,得到相应的第一第二光源相关系数coorelation_coefficient[1,2]和第二第三光源相关系数coorelation_coefficient[2,3]。根据图15所示的实际成像图经计算得到：After the actual imaging map shown in FIG. 15 is obtained through the CMOS imaging device, it can be identified and decoded. In one embodiment, strip-shaped imaging areas corresponding to each light source can be cut out from the actual imaging map, and they can be projected in the vertical direction (that is, the line scanning direction of the CMOS imaging device) to obtain Three projection vectors: feature_vector [1], feature_vector [2], feature_vector [3]; calculate the correlation coefficients between feature_vector [1] and feature_vector [2], and feature_vector [2] and feature_vector [3] to get the corresponding first The correlation coefficient of the second light source coefficient_coefficient [1,2] and the correlation coefficient of the second and third light sources coefficient_coefficient [2,3]. It is calculated from the actual imaging map shown in Figure 15:

coorelation_coefficient[1,2]＝0,912746；coorelation_coefficient [1,2] = 0,912746;

coorelation_coefficient[2,3]＝-0,96256；coorelation_coefficient [2,3] =-0,96256;

由相关系数可以确定第一光源和第二光源强相关，表明它们采用的是具有相同相位的同一驱动模式，继而得出它们所传递的是第一信息,例如二进制数据0。由相关系数可以确定第二光源和第三光源负相关，表明它们采用的是具有相反相位的两种不同驱动模式，继而得出它们所传递的是第二信息,例如二进制数据1。由此，对整个实际成像图解码后得到的结果例如是二进制数据序列“01”。本领域技术人员可以理解，可以采用本领域已知的其他图像分析方法对实际成像图进行分析解码，只要这些方法能够识别出条纹图案的异同即可。The correlation coefficient can determine the strong correlation between the first light source and the second light source, indicating that they use the same driving mode with the same phase, and then it is concluded that they are transmitting the first information, such as binary data 0. The correlation coefficient can determine the negative correlation between the second light source and the third light source, indicating that they use two different driving modes with opposite phases, and then it is concluded that they are transmitting second information, such as binary data 1. Therefore, the result obtained after decoding the entire actual imaging map is, for example, a binary data sequence “01”. Those skilled in the art can understand that other image analysis methods known in the art can be used to analyze and decode the actual imaging map, as long as these methods can identify the similarities and differences of the stripe patterns.

在图15中示出了每个光源的成像区域容纳了若干个亮条纹和暗条纹的情形，但是本领域技术人员可以理解，在通过频率相同但相位相差180°的两个驱动模式来驱动光源的情况下，每个光源的成像区域并不需要容纳多个亮条纹或暗条纹，甚至不需要容纳一个完整的亮条纹或暗条纹(因为通过条纹的一部分也可以判断出两个光源成像是否存在亮暗区别)。这意味着CMOS成像器件可以更加远离光标签(因为不需要较大的光源成像来容纳多个亮条纹或暗条纹)，或者可以将驱动模式的信号频率设置得比较低(比较低的频率对应于比较宽的条纹，在不需要光源成像来容纳多个亮条纹或暗条纹，甚至不需要光源成像来容纳一个完整的亮条纹或暗条纹的情况下，可以使用比较宽的条纹，也即可以使用具有比较低的信号频率的驱动模式，该比较低的信号频率例如可以低至15Hz)。试验中我们可以获得高达光源长度400倍的识别距离，也即，对于街道上设置的一个长度为5厘米的光源，在距离该光源20米范围内的人都可以通过手机对该光源所传递的信息进行识别。如果进一步采用变焦等技术，可以实现更远的识别距离。FIG. 15 shows a case where the imaging area of each light source accommodates several light stripes and dark stripes, but those skilled in the art can understand that the light sources are driven in two driving modes with the same frequency but 180 ° out of phase. In the case of imaging, the imaging area of each light source does not need to accommodate multiple light or dark stripes, or even a complete light or dark stripes (because the part of the stripes can also determine whether the imaging of the two light sources exists The difference between light and dark). This means that the CMOS imaging device can be further away from the light label (because no large light source is needed to image to accommodate multiple bright or dark stripes), or the signal frequency of the drive mode can be set lower (lower frequencies correspond to Wider fringes can be used in situations where light source imaging is not needed to accommodate multiple bright or dark stripes, or even light source imaging is not required to accommodate a complete light or dark fringe. A drive mode with a relatively low signal frequency, which can be as low as 15 Hz, for example). In the test, we can obtain a recognition distance of up to 400 times the length of the light source, that is, for a light source with a length of 5 cm set on the street, anyone within 20 meters of the light source can pass the light source through the mobile phone. Information for identification. If further technologies such as zoom are used, a longer recognition distance can be achieved.

上文结合图13的具有三个光源的光标签200进行了描述，但本领域技术人员显然可以理解，两个或更多个光源也是可行的。The above is described with reference to FIG. 13 with the light tag 200 having three light sources, but those skilled in the art can clearly understand that two or more light sources are also feasible.

在上文的实施例中，以第一驱动模式和第二驱动模式的相位相差180°为例进行了说明，但是可以理解，两者的相位差并不限于180°，而是可以设置为其他数值，例如，90°、270°等。例如，在一个实施例中，将第一驱动模式的相位设置比第二驱动模式的相位提前90°，如此，可以使得在两个光源的驱动模式相同时传递第一信息，在以第一驱动模式驱动第一光源而以第二驱动模式驱动第二光源时传递第二信息，在以第一驱动模式驱动第二光源而以第二驱动模式驱动第一光源时传递第三信息。在另一个实施例中，控制器可以提供更多的驱动模式来驱动光源，其中，每种驱动模式可以具有不同的相位。例如，在一个实施例中，将第一驱动模式的相位设置为比第二驱动模式的相位提前90°，并比第三驱动模式的相位提前180°，如此，可以例如使得在两个光源的驱动模式相同时传递第一信息，在以第一驱动模式驱动第一光源而以第二驱动模式驱动第二光源时传递第二信息，在以第一驱动模式驱动第二光源而以第二驱动模式驱动第一光源时传递第三信息，在以第一驱动模式驱动第一光源而以第三驱动模式驱动第二光源时(或相反时)传递第四信息。In the above embodiment, the phase difference between the first driving mode and the second driving mode is 180 ° as an example, but it can be understood that the phase difference between the two is not limited to 180 °, but can be set to other Value, for example, 90 °, 270 °, etc. For example, in one embodiment, the phase of the first driving mode is set to be 90 ° earlier than the phase of the second driving mode. In this way, the first information can be transmitted when the driving modes of the two light sources are the same. The second information is transmitted when the first light source is driven in the mode and the second light source is driven in the second driving mode, and the third information is transmitted when the second light source is driven in the first driving mode and the first light source is driven in the second driving mode. In another embodiment, the controller may provide more driving modes to drive the light source, wherein each driving mode may have a different phase. For example, in one embodiment, the phase of the first driving mode is set to be 90 ° earlier than the phase of the second driving mode and 180 ° earlier than the phase of the third driving mode. In this way, for example, the The first information is transmitted when the driving modes are the same. The second information is transmitted when the first light source is driven in the first driving mode and the second light source is driven in the second driving mode. The second light source is driven in the first driving mode and the second driving is transmitted. The third information is transmitted when the first light source is driven in the mode, and the fourth information is transmitted when the first light source is driven in the first driving mode and the second light source is driven in the third driving mode (or vice versa).

在一个实施例中，控制器所提供的光源驱动模式可以采用不同的频率，从而当使用CMOS成像器件拍摄光源时可以呈现出具有不同宽度条纹的条纹图案或者无条纹图案。例如，控制器可以为光源提供若干种具有不同频率的驱动模式，以使得当使用CMOS成像器件拍摄光源时可以呈现出条纹宽度分别为例如2个像素、4个像素、8个像素等的条纹图案或者无条纹图案，并可以通过比较这些条纹图案或者无条纹图案来实现对光源所传递信息的识别。例如，如果两个光源的条纹宽度相同，则表明它们传递的是第一信息；如果一个光源的条纹宽度是另一个光源的条纹宽度的大约2倍，则表明它们传递的是第二信息；如果一个光源的条纹宽度是另一个光源的条纹宽度的大约4倍，则表明它们传递的是第三信息；等等。In one embodiment, the light source driving modes provided by the controller may use different frequencies, so that when a CMOS imaging device is used to capture a light source, a striped pattern or a non-striped pattern with stripes of different widths may be presented. For example, the controller can provide several driving modes with different frequencies for the light source, so that when using a CMOS imaging device to photograph the light source, a stripe pattern with a stripe width of, for example, 2 pixels, 4 pixels, 8 pixels, etc. can be presented, respectively. Or there is no stripe pattern, and the information transmitted by the light source can be identified by comparing these stripe patterns or no stripe patterns. For example, if the stripe widths of two light sources are the same, it means that they are transmitting the first information; if the stripe width of one light source is about 2 times that of the other light source, it is that they are transmitting the second information; if The stripe width of one light source is about 4 times the stripe width of the other light source, indicating that they are transmitting third information; and so on.

图16示出了采用不同条纹宽度来实现信息传递的光标签的一个实际成像图，其中，CMOS成像器件的行扫描方向在此是竖直方向。在该成像图中，顶部的条纹图案是第一光源的成像，中间的条纹图案是第二光源的成像，底部的条纹图案是第三光源的成像，第二光源和第三光源的条纹宽度是相同的，并且是第一光源的条纹宽度的两倍。如果将第一光源和第二光源作为一对互为参考并配合使用来传递信息的光源，并且将第二光源和第三光源作为另一对互为参考并配合使用来传递信息的光源，可以确定第一光源和第二光源采用的是同一驱动模式，继而可以得出它们所传递的是第一信息,例如二进制数据0；并且可以确定第二光源和第三光源采用的是具有不同频率的两种不同驱动模式(在此，第三光源的驱动模式的频率是第二光源的驱动模式的频率的两倍)，继而可以得出它们所传递的是第二信息,例如二进制数据1。由此，对整个实际成像图解码后得到的结果例如是二进制数据序列“01”。FIG. 16 shows an actual imaging diagram of an optical label using different stripe widths for information transmission, in which the row scanning direction of the CMOS imaging device is a vertical direction here. In this image, the top stripe pattern is the image of the first light source, the middle stripe pattern is the image of the second light source, the bottom stripe pattern is the image of the third light source, and the stripe width of the second and third light sources is The same, and twice the stripe width of the first light source. If the first light source and the second light source are used as a pair of light sources that are mutually referenced and used together to transmit information, and the second light source and the third light source are used as another pair of light sources that are referenced and used together to transmit information, you can It is determined that the first light source and the second light source use the same driving mode, and then it can be concluded that they pass the first information, such as binary data 0; and it can be determined that the second light source and the third light source use different frequencies Two different driving modes (here, the frequency of the driving mode of the third light source is twice the frequency of the driving mode of the second light source), and then it can be concluded that they are transmitting second information, such as binary data 1. Therefore, the result obtained after decoding the entire actual imaging map is, for example, a binary data sequence “01”.

本领域技术人员可以理解，在控制器所提供的多种驱动模式中，也可以采用不同的频率和不同的相位，从而可以通过条纹宽度差异和相位差的不同组合来表示更多的信息。在一个实施例中，在控制器所提供的多种驱动模式中，可以替代地或者另外地通过考虑光源发出的光的颜色和/或强度来实现更多种类的条纹图案。实际上，不同种类的条纹图案中的条纹可以在宽度、位置、颜色和亮度等中的至少一项上存在区别，只要这些条纹图案能够相互区分即可。Those skilled in the art can understand that among the multiple driving modes provided by the controller, different frequencies and different phases can also be used, so that more information can be represented by different combinations of stripe width differences and phase differences. In one embodiment, among the multiple driving modes provided by the controller, more types of fringe patterns may be implemented instead or in addition by considering the color and / or intensity of light emitted by the light source. In fact, the stripes in different kinds of stripe patterns may differ in at least one of width, position, color, and brightness, as long as the stripe patterns can be distinguished from each other.

控制器可以随着时间的过去根据待传输的信息不断地通过相应的驱动模式来驱动光标签中的各个光源(例如，以30次/秒的频率设置光标签中的各个光源的驱动模式，也即，每经过1/30秒，根据待传输的信息来设置光标签中的各个光源的驱动模式)，使得光标签能够连续地向外传递信息。光学成像器件可以对光标签进行连续扫描，并获取光标签的一帧或多帧图像，从而识别出光标签在各帧图像被拍摄时所传递的信息，这些信息可以构成一个相应的信息序列。The controller can continuously drive each light source in the light tag through the corresponding drive mode according to the information to be transmitted over time (for example, set the drive mode of each light source in the light tag at a frequency of 30 times / second, and also That is, the driving mode of each light source in the optical tag is set according to the information to be transmitted every 1/30 second, so that the optical tag can continuously transmit information outward. The optical imaging device can continuously scan the optical label and acquire one or more frames of the optical label, thereby identifying the information transmitted by the optical label when each frame of the image is captured, and these information can form a corresponding information sequence.

在一个实施例中，光标签中还可以另外包括位于用于传递信息的光源附近的一个或多个定位标识，该定位标识例如可以是特定形状或颜色的灯，该灯例如可以在工作时保持常亮。该定位标识可以有助于光学成像器件(例如手机)的用户容易地发现光标签。另外，当光学成像器件被设置为对光标签进行拍摄的模式时，定位标识的成像比较明显，易于识别。因此，布置于信息传递光源附近的一个或多个定位标识还能够有助于手机快速地确定信息传递光源的位置，从而有助于后续的图像识别。在一个实施例中，在进行识别时，可以首先在图像中对定位标识进行识别，从而在图像中发现光标签的大致位置。在识别了定位标识之后，可以基于定位标识与信息传递光源之间的预先确定的相对位置关系，确定图像中的一个或多个区域，该区域涵盖信息传递光源的成像位置。接着，可以针对这些区域进行识别，以确定光源所传递的信息。In one embodiment, the light tag may further include one or more positioning marks located near the light source for transmitting information. The positioning marks may be, for example, lights of a specific shape or color, which may be maintained during work, for example. Always on. The positioning mark can help a user of an optical imaging device (such as a mobile phone) easily find the light tag. In addition, when the optical imaging device is set to the mode of shooting the optical label, the imaging of the positioning mark is obvious and easy to identify. Therefore, one or more positioning marks arranged near the information transmission light source can also help the mobile phone quickly determine the position of the information transmission light source, thereby facilitating subsequent image recognition. In one embodiment, when performing identification, the positioning mark may be identified in the image first, so that the approximate position of the light tag is found in the image. After the positioning mark is identified, one or more areas in the image may be determined based on a predetermined relative position relationship between the positioning mark and the information transmission light source, and the area covers the imaging position of the information transmission light source. These areas can then be identified to determine the information passed by the light source.

图17是根据本发明的一个实施例的包括定位标识的光标签的示意图，其中包括三个水平布置的信息传递光源201、202和203，以及位于信息传递光源两侧的竖直布置的两个定位标识灯204和205。通过定位标识灯以及预先确定的定位标识灯与信息传递光源之间的相对位置关系，可以方便地确定信息传递光源的成像区域。FIG. 17 is a schematic diagram of a light label including a positioning mark according to an embodiment of the present invention, which includes three horizontally-arranged information transmission light sources 201, 202, and 203, and two vertically-arranged two information transmission light sources positioned on both sides of the information transmission light source. Locate the identification lights 204 and 205. The imaging area of the information transmission light source can be conveniently determined through the positioning identification light and the relative positional relationship between the predetermined positioning identification light and the information transmission light source.

图18示出了用肉眼观察时的根据本发明的一个实施例的包括定位标识的光标签。该光标签中，三个水平布置的信息传递光源正在进行信息传输，另外两个竖直布置的定位标识灯位于信息传递光源的两侧。在用肉眼观察时，光标签中的信息传递光源类似于普通的照明光源。FIG. 18 shows a light tag including a positioning mark according to an embodiment of the present invention when viewed with the naked eye. In this optical label, three horizontally arranged information transmission light sources are transmitting information, and the other two vertically positioned positioning indicator lights are located on both sides of the information transmission light source. When viewed with the naked eye, the information transmission light source in the light tag is similar to an ordinary illumination light source.

在一个实施例中，光标签中可以包括环境光检测电路，该环境光检测电路可以用于检测环境光的强度。控制器可以基于检测到的环境光的强度来调整光源在开启时所发出的光的强度。例如，在环境光比较强时(例如白天)，使得光源发出的光的强度比较大，而在环境光比较弱时(例如夜里)，使得光源发出的光的强度比较小。In one embodiment, the light tag may include an ambient light detection circuit, and the ambient light detection circuit may be used to detect the intensity of the ambient light. The controller may adjust the intensity of the light emitted by the light source when it is turned on based on the detected intensity of the ambient light. For example, when the ambient light is relatively strong (such as daytime), the intensity of the light emitted by the light source is relatively large, and when the ambient light is relatively weak (such as at night), the intensity of the light emitted by the light source is relatively low.

本发明的上述方案不需要对单个光源的成像的精确检测(而是通过比较一对互为参考并配合使用的光源的成像)，因此，其在实际的信息传输中具有极强的稳定性和可靠性。特别是，在本发明中，在确定光源传递的信息时并不是对单个光源的成像进行分析，而是通过比较一对光源的成像，这是非常有利的，因为光标签中的光源位于大致相同的位置，且经受相同的环境光照条件、干扰、噪声等，因此通过比较一对光源的成像，而不是仅单独地分析某个光源的成像，可以改善对光源所传递的信息的识别的准确性和稳定性，特别适合于远距离识别和户外识别。The above solution of the present invention does not require accurate detection of the imaging of a single light source (but by comparing the imaging of a pair of light sources that are used as a reference and cooperate with each other). Therefore, it has extremely strong stability and reliability. In particular, in the present invention, instead of analyzing the imaging of a single light source when determining the information transmitted by the light source, it is very advantageous to compare the imaging of a pair of light sources, because the light sources in the light label are located approximately the same Location, and experience the same ambient lighting conditions, interference, noise, etc., so by comparing the imaging of a pair of light sources, rather than just analyzing the imaging of a single light source, the accuracy of identifying the information transmitted by the light source can be improved And stability, especially suitable for long-distance recognition and outdoor recognition.

而且，更为有利的，由于本发明的上述方案通过比较一对光源的成像来获得光源所传递的信息，因此每个光源的成像中并不需要包括数量较多的条纹(在某些情况下甚至不需要包括一个完整的条纹)，这进一步有助于远距离识别，并且使得允许降低用于在光源成像中产生条纹的驱动模式的信号频率。Moreover, it is more advantageous, because the above scheme of the present invention obtains the information transmitted by the light sources by comparing the imaging of a pair of light sources, the imaging of each light source does not need to include a large number of stripes (in some cases It is not even necessary to include a complete fringe), which further facilitates long-distance recognition and allows to reduce the signal frequency of the driving mode used to generate fringe in the imaging of the light source.

与用于近距离识别的条形码和二维码相比，光标签通过发出不同的光来传递信息，其具有远距、可见光条件要求宽松、指向性强、可定位的优势，并且光标签所传递的信息可以随时间迅速变化，从而可以提供大的信息容量。因此，光标签具有更强的信息交互能力，从而可以为用户和商家提供巨大的便利性。为了基于光标签向用户和商家提供对应的服务，可以给每个光标签分配有唯一标识符(ID)，该标识符可以用于由光标签的制造者、管理者及使用者等唯一地识别或标识光标签。例如，可由光标签发布其标识符，而使用者可以使用例如手机上内置的图像采集设备或成像器件对光标签进行图像采集来获得该光标签传递的信息(例如标识符)，从而可以访问基于该光标签提供的服务。Compared with bar codes and two-dimensional codes used for short-distance identification, optical tags transmit different light to transmit information. It has the advantages of long-distance, visible light conditions requiring loose, strong directivity, and positioning. The information can change rapidly over time, which can provide a large information capacity. Therefore, light tags have stronger information interaction capabilities, which can provide great convenience to users and businesses. In order to provide users and businesses with corresponding services based on optical labels, each optical label can be assigned a unique identifier (ID), which can be used to uniquely identify the optical label manufacturer, manager, user, etc. Or identification light label. For example, an optical tag can be used to publish its identifier, and a user can use, for example, an image capture device or imaging device built into a mobile phone to image the optical tag to obtain information (such as an identifier) passed by the optical tag. The services provided by this light label.

与光标签相关的信息或服务可以保存或设置在一个或多个服务器上。如图19所示，可以在至少一个服务器上保存各个光标签的标识符(ID)、位置信息、与该光标签相关的服务或者其他信息，例如该光标签是固定式还是移动式、与该光标签相关的其他描述信息或属性，如光标签的物理尺寸、朝向等。这样的服务器与分布在各个位置的光标签共同构成光标签网络。该光标签网络中每个光标签可以是固定式光标签或移动式光标签。固定式光标签通常指位置基本保持不变的光标签，例如，安装在商店门头，建筑物上的光标签。移动式光标签通常指位置随时可变的光标签，例如，安装在例如汽车等可移动装置上的光标签，佩戴在人身上的光标签。Information or services related to light tags can be saved or set up on one or more servers. As shown in FIG. 19, an identifier (ID), location information, services related to the optical tag, or other information of each optical tag may be stored on at least one server, such as whether the optical tag is fixed or mobile, and the Other descriptive information or attributes related to the optical label, such as the physical size and orientation of the optical label. Such a server and an optical label distributed at various locations together constitute an optical label network. Each optical label in the optical label network may be a fixed optical label or a mobile optical label. Fixed light tags usually refer to light tags whose positions remain substantially unchanged, for example, light tags installed on the door of a store or on a building. Mobile light tags generally refer to light tags with variable positions, for example, light tags mounted on mobile devices such as cars, and light tags worn on humans.

在这样的光标签网络中，每个光标签的位置信息可包括绝对位置和/或相对位置。绝对位置是指该光标签在物理世界中的实际位置，例如可以通过GPS信息来指示。光标签的相对位置是指该光标签相对于另一光标签的位置。在一个示例中，光标签的相对位置可以通过该光标签相对于另一光标签的空间位移来表示，也就是通过该光标签在以另一光标签(下文也可称为参考光标签)为原点的坐标系中位置来进行表示，例如，相对位置可表示为(x,y,z:refID)，其中refID为作为坐标系原点的光标签的标识符，即参考光标签的标识符，x,y,z分别表示相对于该坐标系原点的三个方向的位移。优选地，每个光标签可以具有一个或多个相对位置。每个光标签的绝对位置可以通过递归地遍历光标签的相对位置来获取。例如，对于某个光标签，如果所对应的其中一个参考光标签的绝对位置已经被确定，则可以根据该光标签的相对位置和该参考光标签的绝对位置获得该光标签的绝对位置。如果该光标签对应的所有参考光标签的绝对位置都未确定，则以每个参考光标签为起点，遍历该参考光标签的所有相对位置，如果其中一个相对位置对应的参考光标签的绝对位置已知，则可根据该相对位置及该已知的绝对位置获得作为起点的参考光标签的绝对位置，从而进一步获得该光标签的绝对位置。上述过程可以不断重复直到获得某个已被确定的绝对位置为止。In such an optical tag network, the position information of each optical tag may include an absolute position and / or a relative position. The absolute position refers to the actual position of the light tag in the physical world, and can be indicated by GPS information, for example. The relative position of an optical tag refers to the position of the optical tag relative to another optical tag. In one example, the relative position of an optical tag can be represented by the spatial displacement of the optical tag relative to another optical tag, that is, by using the optical tag in another optical tag (hereinafter also referred to as a reference optical tag) as The position in the coordinate system of the origin is expressed, for example, the relative position can be expressed as (x, y, z: refID), where refID is the identifier of the optical label as the origin of the coordinate system, that is, the identifier of the reference optical label, x , y, z represent displacements in three directions relative to the origin of the coordinate system. Preferably, each light tag may have one or more relative positions. The absolute position of each light tag can be obtained by recursively traversing the relative position of the light tag. For example, for an optical label, if the corresponding absolute position of one of the reference optical labels has been determined, the absolute position of the optical label may be obtained according to the relative position of the optical label and the absolute position of the reference optical label. If the absolute positions of all the reference optical labels corresponding to the optical label are not determined, starting from each reference optical label, traverse all the relative positions of the reference optical label, and if one of the relative positions corresponds to the absolute position of the reference optical label If known, the absolute position of the reference optical tag as a starting point can be obtained according to the relative position and the known absolute position, thereby further obtaining the absolute position of the optical tag. The above process can be repeated until a certain absolute position has been obtained.

如上文提到的，光标签在工作过程中可以传递其标识信息(例如ID信息)，终端设备通过对光标签的扫描得到光标签的ID信息，进而基于该ID信息对服务器进行查询就可以获得光标签的地理位置信息。与此同时，基于光标签的地理位置信息以及光标签与终端设备的相对位置可以计算出对光标签进行扫描的终端设备的地理位置，即对于扫描该光标签的终端设备进行精确定位(也称为反向定位)。其中可以使用各种可行的反向定位方法来确定光标签与对其进行扫描的终端设备之间的相对位置关系。例如，可基于所采集的光标签图像获取终端设备与光标签的相对距离，然后基于该相对距离和终端设备的朝向获得该终端设备与所采集的光标签之间相对位置，从而可基于这样的相对位置关系和光标签的地理位置信息计算出该终端设备的地理位置。目前市场销售的很多终端设备上通常配备有双目摄像头或深度摄像头，利用配备有双目摄像头或深度摄像头的成像装置对光标签进行图像采集，基于所采集的图像就能获得该终端设备与光标签之间的相对距离。又例如，当用户使用终端设备上内置的普通摄像头对光标签进行图像采集时，可以根据所识别的光标签ID信息从服务器获得光标签的物理尺寸，然后基于所采集的光标签的图像的尺寸、拍摄到该光标签的图像时的焦距参数、光标签的物理尺寸等，利用透镜物象公式和物像关系也可以获得该终端设备与光标签的相对距离。又例如，可以通过光标签的成像大小或者通过手机上任何具有测距功能的应用来确定终端设备与光标签的相对距离，并使用两个或更多个光标签通过三角定位来确定终端设备与任一光标签之间的相对位置关系。也可以通过确定终端设备与光标签的相对距离并通过分析光标签在终端设备上成像的透视畸变来确定终端设备与光标签之间的相对位置关系。As mentioned above, the optical tag can transmit its identification information (such as ID information) during the work process. The terminal device can obtain the optical tag ID information by scanning the optical tag, and then query the server based on the ID information to obtain Geographical information of light tags. At the same time, based on the geographic position information of the optical tag and the relative position of the optical tag and the terminal device, the geographic position of the terminal device that scans the optical tag can be calculated, that is, the precise positioning of the terminal device that scans the optical tag (also known as For reverse positioning). Various feasible reverse positioning methods can be used to determine the relative position relationship between the optical tag and the terminal device that scans it. For example, the relative distance between the terminal device and the light label may be obtained based on the collected light label image, and then the relative position between the terminal device and the collected light label may be obtained based on the relative distance and the orientation of the terminal device, and thus may be based on such The relative position relationship and the geographic position information of the optical tag calculate the geographic position of the terminal device. Many terminal devices currently on the market are usually equipped with a binocular camera or a depth camera. Using an imaging device equipped with a binocular camera or a depth camera to perform image acquisition on a light tag, the terminal device and light can be obtained based on the acquired image. The relative distance between the labels. As another example, when a user uses an ordinary camera built in a terminal device to perform image collection on a light tag, the physical size of the light tag can be obtained from the server according to the identified light tag ID information, and then based on the size of the collected light tag image , The focal length parameter when the image of the optical label is captured, the physical size of the optical label, etc., the relative distance between the terminal device and the optical label can also be obtained by using the lens object image formula and the object image relationship. For another example, the relative distance between the terminal device and the optical label can be determined by the imaging size of the optical label or any application with a ranging function on the mobile phone, and the two devices can be used to determine the terminal device and the triangular position by using three or more optical labels. Relative positional relationship between any light tags. The relative position relationship between the terminal device and the optical label may also be determined by determining the relative distance between the terminal device and the optical label and analyzing the perspective distortion of the imaging of the optical label on the terminal device.

例如，在一个实施例中，可使用至少两个光标签来进行定位。可针对每一个光标签执行如下步骤：For example, in one embodiment, at least two optical tags may be used for positioning. The following steps can be performed for each optical label:

步骤一：使用成像设备采集光标签的ID信息。Step 1: Use the imaging device to collect the ID information of the light tag.

步骤二：通过该ID信息查询获得光标签的物理尺寸信息和地理位置信息。Step 2: Obtain the physical size information and geographic location information of the optical tag through the ID information query.

步骤三：采用成像设备的默认焦距对光标签进行拍照，以获得光标签的图像。由于采用的是成像设备的默认焦距，因此拍摄到的光标签图像可能会比较模糊。Step 3: Take a photo of the light label using the default focal length of the imaging device to obtain an image of the light label. Because the default focal length of the imaging device is used, the captured light label image may be blurred.

步骤四：调节并优化成像设备的焦距，以获得光标签的清晰图像。例如，可以基于默认焦距，首先尝试增大焦距，如果光标签图像变清晰，就继续增大焦距，如果光标签图像变得模糊，就反方向调节，即减小焦距；反之亦然。在焦距调节过程中，为了确定光标签图像的清晰度，可以对光标签图像进行纹理特征提取，光标签图像越清晰，所对应的纹理信息越简单，纹理的密度越小，因此，可以根据光标签图像的纹理的密度来确定最优的焦距参数，当经过多次迭代后不能获得更小的纹理密度时，可以认为具有最小的纹理密度的图像是清晰的图像，并将与所获得的最小的纹理密度对应的焦距参数作为最优的焦距参数。Step 4: Adjust and optimize the focal length of the imaging device to obtain a clear image of the light label. For example, based on the default focal length, you can first try to increase the focal length. If the light label image becomes clear, continue to increase the focal length. If the light label image becomes blurred, adjust in the opposite direction, that is, decrease the focal length; and vice versa. In the focus adjustment process, in order to determine the sharpness of the light label image, texture features can be extracted from the light label image. The clearer the light label image, the simpler the corresponding texture information and the smaller the density of the texture. The density of the texture of the label image is used to determine the optimal focal length parameter. When a smaller texture density cannot be obtained after multiple iterations, the image with the smallest texture density can be considered as a clear image and will be the same as the obtained minimum. The focal length parameter corresponding to the texture density is used as the optimal focal length parameter.

步骤五：基于最优的焦距参数，拍摄光标签的清晰图像，然后，利用简单的透镜物象公式和物像关系，根据光标签的清晰图像的尺寸、光标签的物理尺寸和最优的焦距参数计算成像设备与光标签的相对距离。Step 5: Take a clear image of the light label based on the optimal focal length parameter. Then, using a simple lens object image formula and object image relationship, according to the size of the clear image of the light label, the physical size of the light label, and the optimal focal length parameter Calculate the relative distance between the imaging device and the light tag.

在获得了成像设备与至少两个光标签中的每一个的相对距离后，可以利用三角定位法确定成像设备的具***置信息，也即成像设备在物理世界坐标系中的具体坐标。图20为三角定位方法的示意图，其中使用了两个光标签(光标签1和光标签2)进行三角定位。After the relative distance between the imaging device and each of the at least two light labels is obtained, the specific position information of the imaging device, that is, the specific coordinates of the imaging device in the physical world coordinate system can be determined using the triangular positioning method. FIG. 20 is a schematic diagram of a triangular positioning method, in which two optical tags (a light tag 1 and a light tag 2) are used for triangle positioning.

另外，当使用两个光标签进行三角定位时，通常会获得两个候选位置。在这种情况下，可能需要从这两个候选位置中进行选择。在一个实施方式中，可以结合成像设备(例如，手机)本身的定位信息(例如，GPS信息)来选择其中一个候选位置。例如，可以选择与GPS信息更为接近的一个候选位置。在另一个实施方式中，可以进一步考虑各个光标签的朝向信息，该朝向信息实际上限定了可以观察到光标签的区域，因此，可以基于该朝向信息来选择其中一个候选位置。光标签的朝向信息同样可以存储于服务器，并可以通过光标签的ID信息来查询获得。在上述实施例中以两个光标签为例进行了说明，但本领域技术人员可以理解，上述基于三角定位的方法同样可以适用于三个或更多个光标签的情形。实际上，使用三个或更多个光标签可以实现更为精确的定位，并且通常不会出现多个候选点。In addition, when two light tags are used for triangulation, two candidate positions are usually obtained. In this case, you may need to choose from these two candidate positions. In one embodiment, one of the candidate positions may be selected in combination with positioning information (for example, GPS information) of the imaging device (for example, a mobile phone) itself. For example, a candidate location closer to the GPS information may be selected. In another embodiment, the orientation information of each light tag may be further considered. The orientation information actually defines an area where the light tag can be observed. Therefore, one of the candidate positions may be selected based on the orientation information. The orientation information of the light tag can also be stored in the server, and can be obtained by querying the ID information of the light tag. In the above embodiment, two optical tags are taken as an example for description, but those skilled in the art can understand that the above-mentioned method based on triangulation can also be applied to the case of three or more optical tags. In fact, more accurate positioning can be achieved using three or more light tags, and often multiple candidate points do not appear.

在又一个实施例中，还可以采用下面的反向定位方法，该实施例并不需要使用至少两个光标签，而是可以使用一个光标签进行反向定位。该实施例的方法包括如下步骤：In another embodiment, the following reverse positioning method may also be adopted. This embodiment does not need to use at least two optical tags, but may use one optical tag for reverse positioning. The method of this embodiment includes the following steps:

步骤二：通过该ID信息查询获得光标签的地理位置信息以及其上的多个点的相关信息。该相关信息例如是这些点在光标签上的位置信息以及它们的坐标信息。Step 2: Obtain the geographic position information of the light tag and related information of multiple points on the optical tag through the ID information query. The related information is, for example, position information of the points on the light label and their coordinate information.

步骤三：采用成像设备的默认焦距对光标签进行拍照，以获得光标签的图像。例如上文介绍的可以根据光标签图像的纹理的密度来确定最优的焦距参数，当经过多次迭代后不能获得更小的纹理密度时，可以认为具有最小的纹理密度的图像是清晰的图像，并将与所获得的最小的纹理密度对应的焦距参数作为最优的焦距参数。Step 3: Take a photo of the light label using the default focal length of the imaging device to obtain an image of the light label. For example, the above can be used to determine the optimal focal length parameter according to the texture density of the light label image. When a smaller texture density cannot be obtained after multiple iterations, the image with the smallest texture density can be considered as a clear image , And use the focal length parameter corresponding to the obtained minimum texture density as the optimal focal length parameter.

步骤五：基于最优的焦距参数，拍摄光标签的清晰图像，实现如下文所介绍的反向定位：Step 5: Take a clear image of the light label based on the optimal focal length parameters to achieve the reverse positioning as described below:

参见图21，图21为光标签在成像设备上的成像过程示意图。以光标签的质心为原点建立物坐标系(X，Y，Z)，以成像设备所在的位置F _c为原点建立像坐标系(x，y，z)，物坐标系也称物理世界坐标系，像坐标系也称为相机坐标系。另外，以成像设备所采集的光标签的图像左上角的点为坐标原点，在光标签的像平面内建立二维坐标系(u，v)，称为像平面坐标系，该像平面与光轴(即Z轴)的交点为主点，(c _x，c _y)为主点在像平面坐标系中的坐标。光标签上的任意一点P在物坐标系中的坐标为(X,Y,Z)，所对应的像点为q，其在像坐标系中的坐标为(x，y，z)，在像平面坐标系中的坐标为(u，v)。在成像过程中，像坐标系相对于物坐标系不只有位移的改变，还有角度的旋转，物坐标系(X，Y，Z)和像坐标系(x，y，z)之间的关系可以表示为： Referring to FIG. 21, FIG. 21 is a schematic diagram of an imaging process of a light label on an imaging device. The object coordinate system (X, Y, Z) is established with the centroid of the light label as the origin, and the image coordinate system (x, y, z) is established with the position F _c of the imaging device as the origin. The object coordinate system is also called the physical world coordinate system. The image coordinate system is also called the camera coordinate system. In addition, a two-dimensional coordinate system (u, v) is established in the image plane of the optical label by using the upper-left point of the image of the optical label image collected by the imaging device as the coordinate origin. The image plane and light The intersection point of the axis (ie, the Z axis) is the main point, and (c _x , c _y ) is the coordinate of the main point in the image plane coordinate system. The coordinates of any point P on the light label in the object coordinate system is (X, Y, Z), and the corresponding image point is q, and its coordinates in the image coordinate system are (x, y, z). The coordinates in the plane coordinate system are (u, v). During the imaging process, the image coordinate system not only changes the displacement relative to the object coordinate system, but also the rotation of the angle, and the relationship between the object coordinate system (X, Y, Z) and the image coordinate system (x, y, z). It can be expressed as:

定义变量：x′＝x/z，y′＝y/z；Define variables: x ′ = x / z, y ′ = y / z;

那么，像平面坐标系中的坐标：Well, like coordinates in a plane coordinate system:

u＝f _x*x′+c _x且v＝f _y*y′+c _y(2)； u = f _x * x ′ + c _x and v = f _y * y ′ + c _y (2);

其中，f _x和f _y分别为成像设备在x轴和y轴方向的焦距，c _x，c _y为主点在像平面坐标系中的坐标，f _x、f _y、c _x、c _y都为成像设备内部的参数，可以提前测知。旋转矩阵R和位移矢量t分别表示物坐标系相对于像坐标系的姿态信息(即成像设备相对于光标签的姿态，就是成像设备的中轴线相比光标签的偏向，也称为成像设备相对于光标签的朝向，例如，当成像设备正对光标签时，R＝0)和位移信息(即成像设备与光标签之间的位移)。在三维空间中，旋转可以分解为绕各自坐标轴的二维旋转，如果依次绕x,y,z轴旋转角度ψ，

和θ，那么总的旋转矩阵R是三个矩阵R _x(ψ)，

R _z(θ)的乘积，即：

其中， Wherein, f _x and F _y are the focal length of the image forming apparatus in the x-axis and y-axis direction, c _x, c _y coordinate point based on the image plane coordinate _{_{system, f x, f y, c}} x, c y are The parameters inside the imaging device can be measured in advance. The rotation matrix R and the displacement vector t respectively represent the attitude information of the object coordinate system relative to the image coordinate system (that is, the attitude of the imaging device relative to the optical label, that is, the deviation of the imaging device's central axis compared to the optical label, also referred to as the imaging device relative For the orientation of the optical label, for example, when the imaging device is facing the optical label, R = 0) and displacement information (that is, the displacement between the imaging device and the optical label). In three-dimensional space, rotation can be decomposed into two-dimensional rotations about their respective coordinate axes. If you rotate the angle ψ about the x, y, and z axes in turn,

And θ, then the total rotation matrix R is three matrices R _x (ψ),

The product of R _z (θ), that is:

among them,

为了简单起见，并因为是本领域公知的，在此不再展开计算，仅简单地将旋转矩阵写成如下形式：For the sake of simplicity, and because it is well known in the art, the calculation is not expanded here, and the rotation matrix is simply written as follows:

而位移矢量t可以简单地写成如下形式，即The displacement vector t can be simply written as:

于是得到如下关系式：So we get the following relationship:

其中，s为物像转换因子，等于像平面的大小与成像设备分辨率的比值，也是已知的。Among them, s is an object image conversion factor, which is equal to the ratio of the size of the image plane to the resolution of the imaging device, which is also known.

根据在步骤二获得的在光标签上的多个点(例如至少四个点A、B、C和D)的相关信息(例如，这些点在光标签上的位置信息)确定这些点在光标签图像中的像点，例如A’、B’、C’和D’。这四个点A、B、C和D例如可以分别光标签的左右两侧，或者可以是位于光标签的四个角的四个单独的点光源等等。该四个点的坐标信息(X _A，Y _A，Z _A)、(X _B，Y _B，Z _B)、(X _C，Y _C，Z _C)和(X _D，Y _D，Z _D)也在上述步骤二中被获得。通过测量对应的四个像点A’、B’、C’和D’在像平面坐标系中的坐标(u _A’，v _A’)、(u _B’，v _B’)、(u _C’，v _C’)和(u _D’，v _D’)，代入上述关系式(3)，求解得到旋转矩阵R和位移矢量t，于是就得到了物坐标系(X，Y，Z)和像坐标系(x，y，z)之间的关系。基于该关系，就可以得到成像设备相对于光标签的姿态信息和位移信息，从而实现对成像设备的定位。图22简化示出了物坐标系与像坐标系之间的关系。然后，根据在上述步骤二中获得的光标签的地理位置信息，借由旋转矩阵R和位移矢量t，就可以计算出成像设备的实际具***置和姿态，通过位移矢量t确定成像设备的具***置，旋转矩阵R确定成像设备相对于光标签的姿态。 Determine the points on the light label according to the related information (for example, the position information of these points on the light label) of multiple points on the light label (for example, at least four points A, B, C, and D) obtained in step 2. Image points in the image, such as A ', B', C ', and D'. The four points A, B, C, and D may be, for example, the left and right sides of the light tag, respectively, or may be four separate point light sources located at the four corners of the light tag. The coordinate information of the four points (X _A , Y _A , Z _A ), (X _B , Y _B , Z _B ), (X _C , Y _C , Z _C ), and (X _D , Y _D , Z _D ) Also obtained in step two above. By measuring the coordinates (u _{A '} , v _A' ), (u _{B '} , v _B' ), (u _C ) of the corresponding four image points A ', B', C ', and D' in the image plane coordinate system _' , V _C' ) and (u _{D '} , v _D' ), substituting into the above-mentioned relationship (3), solving to obtain the rotation matrix R and the displacement vector t, then the object coordinate system (X, Y, Z) and Like the relationship between coordinate systems (x, y, z). Based on this relationship, posture information and displacement information of the imaging device with respect to the optical label can be obtained, thereby positioning the imaging device. FIG. 22 shows a simplified relationship between the object coordinate system and the image coordinate system. Then, according to the geographic position information of the optical tag obtained in the above step 2, by rotating the matrix R and the displacement vector t, the actual specific position and attitude of the imaging device can be calculated, and the specific position of the imaging device can be determined by the displacement vector t. The rotation matrix R determines the attitude of the imaging device with respect to the optical label.

图23给出了根据本发明的一个实施例的基于光标签的服务提供方法的流程图。如图23所示，该方法主要包括通过用户携带的终端设备对与服务提供者关联的光标签进行图像采集(S1)；根据所采集的光标签图像获取获取与服务提供者相关的信息并确定终端设备的位置信息(S2)；由终端设备根据所获取的信息生成服务请求，并将服务请求及终端设备的位置信息发送给相应的服务提供者(S3)；服务提供者基于收到的服务请求和所述位置信息来向用户提供所请求的服务(S4)。FIG. 23 is a flowchart of a light tag-based service providing method according to an embodiment of the present invention. As shown in FIG. 23, the method mainly includes performing image collection on a light tag associated with a service provider through a terminal device carried by a user (S1); acquiring and obtaining information related to the service provider according to the collected light tag image and determining Location information of the terminal device (S2); the terminal device generates a service request based on the obtained information, and sends the service request and the location information of the terminal device to the corresponding service provider (S3); the service provider is based on the received service The request and the location information are used to provide the requested service to the user (S4).

为更好地理解本发明，下面以零售行业为例来进行说明，假设服务提供者为零售店，用户通过随身携带的终端设备中的成像器件(例如摄像头)扫描与该零售店关联的光标签，从而进入到该零售店的购买页面，选择要购买的商品并进行下单、支付等操作；并且同时基于对光标签的扫描确定该终端设备相对于零售店的位置，将所确定的位置信息连同订单信息一起发送给零售店，以供备货和配送用。例如，某个游客在行走过程中看到某处风景突然想要拿纸和笔画下来时，可以拿手机扫描其周围环境中的可用光标签，进入相应零售店的购买页面选择笔、纸，并且也可以选择水或饮料等其他商品，下单后就可以一边休息一边欣赏风景，稍等片刻就会有相应店员将其订购的商品送过来。又例如，当抱着小孩在外面行走时，突然发现没带尿布，可以拿手机扫描其周围环境中的光标签，发现相应零售店并通过其购买页面订购尿布，然后在原地稍等片刻或抱着孩子继续慢行，短时间内会由店员将其订购的尿布送到顾客身边。In order to better understand the present invention, the following uses the retail industry as an example for description. It is assumed that the service provider is a retail store, and the user scans the optical tag associated with the retail store through an imaging device (such as a camera) in the terminal device that the user carries. To enter the purchase page of the retail store, select the products to be purchased and place operations such as ordering and payment; and at the same time determine the position of the terminal device relative to the retail store based on the scanning of the light tag, and then determine the location information Send to retail store with order information for stocking and distribution. For example, when a tourist sees a certain place during walking and suddenly wants to take paper and pen, he can use his mobile phone to scan the available light tags in his surroundings, enter the purchase page of the corresponding retail store, and select pen and paper. You can also choose other products such as water or drinks. After you place your order, you can enjoy the scenery while resting. After a while, the corresponding clerk will deliver the products ordered by them. For another example, when walking with a child outside, you suddenly find that you do n’t have a diaper. You can use a mobile phone to scan the light tags in the surrounding environment, find a corresponding retail store and order diapers through its purchase page, and then wait for a while or hold it in place. As the child continues to walk slowly, the clerk will deliver the diaper he ordered to the customer in a short time.

与传统零售店运营方式相比，采用本发明实施例的服务提供方法，零售店可以不必提供货品展览区供顾客浏览，也不需要雇佣大量服务员管理货架上商品、进行补货或摆货、理货、结账等等各项经营工作；而是可以作为货品仓库来使用，可以采用自动取货的方式或者可以仅留店员进去取货的通道。这种零售店的店员通常待在零售店外，其工作任务主要包括取货和短距离配送。因此，可以显著地降低场地成本、人力成本和时间成本。同时，对于用户而言，当其产生购买商品的需求时，可以随时利用携带的终端设备(例如手机)对其视野范围内的相关光标签进行扫描来进入相应零售店的购买页面进行购买和支付操作，稍等一段时间就可以收到由商家配送的商品，或者在一定范围内继续活动也可以收到由商家配送的商品。应理解，以零售行业作为服务提供者仅是举例而非进行任何限制，除上述商品配送之外，可在短时间内提供至用户当前位置处的服务都可以作为本实施例中服务提供者提供的服务，例如城市导游、代驾、用车、冲印等等。Compared with the traditional retail store operation mode, the service providing method of the embodiment of the present invention can eliminate the need for the retail store to provide a product exhibition area for customers to browse, and it does not need to hire a large number of waiters to manage the goods on the shelves, perform replenishment or placement, and organize Goods, checkout and other business operations; instead, it can be used as a goods warehouse, you can use the automatic pick-up method or you can only leave the clerk in the pick-up channel. This kind of retail store clerk usually stays outside the retail store, and its work tasks mainly include pickup and short-distance distribution. As a result, site costs, labor costs, and time costs can be significantly reduced. At the same time, for users, when they need to purchase goods, they can use the portable terminal device (such as a mobile phone) to scan the relevant light tags within their field of vision at any time to enter the purchase page of the corresponding retail store for purchase and payment. Operation, wait a while to receive the goods delivered by the merchant, or continue the activity within a certain range can also receive the goods delivered by the merchant. It should be understood that the use of the retail industry as a service provider is merely an example rather than any limitation. In addition to the above-mentioned product distribution, the services that can be provided to the user's current location within a short time can be provided as the service provider in this embodiment. Services, such as city guides, driving, car use, printing, and more.

与传统的网络购物方式相比，本发明可随时随地基于光标签进行购物，提供了一种流动性的服务，不要求用户预先知道服务访问地址，也不要求用户输入很多信息，例如接受服务的设定位置信息；而且用户不再受位置的约束，可以随时随地接受服务。而现有的方案，要么是复杂，需要提供很多信息，要么是地点固定，不能提供流动性的服务。Compared with the traditional online shopping method, the present invention can perform shopping based on light tags anytime, anywhere, and provides a liquidity service, which does not require users to know the service access address in advance, and does not require users to enter a lot of information, such as receiving service Set location information; and users are no longer constrained by location and can receive services anytime, anywhere. The existing solutions are either complex and need to provide a lot of information, or they are fixed in location and cannot provide liquid services.

继续参考图23，更具体地，在步骤S1，当用户希望获得某些服务时，可以通过用户携带的终端设备对其周围环境中与服务提供者关联的光标签进行图像采集。在一个实施例中，可以给每个服务提供者分配与其关联的特定的光标签。例如通常与零售店关联的光标签可以安装在方便顾客进行图像采集的区域，例如将光标签安装在零售店外部，如门头上。可以将光标签与零售店的招牌集成在一起，当使用手机对零售店的招牌进行图像采集时，就可以获取与其集成在一起的光标签传递的信息。当然，也可以将光标签设置在零售店的招牌的旁边。又例如，还可以将与零售店关联的光标签设置在易于被顾客发现的广告牌上，这样的广告牌并非必须安装在零售店外表面，还可以安装在零售店周围一定范围内易于被顾客发现的任一位置，例如零售店所在的或其附近的某栋高大建筑物的外表面。这样，当用户在其视野范围内发现想要访问的服务时，可以通过其终端设备对与该服务关联的光标签进行扫描来访问该服务。在又一个实施例中，每个光标签可以关联一个或多个服务提供者。例如，光标签可以关联一个统一的服务接口，通过该统一服务接口可以访问由一个或多个服务提供者提供的一种或多种类型的服务。在该实施例中，可以将这样的光标签设置在环境中容易被发现或比较显著的位置，而附近一定范围内的各个服务提供者可以将其提供的服务在该统一服务接口进行相关注册。这样，用户想要访问其附近的某个或某些服务时，只需要扫描这样的光标签即可。即使想要访问的服务不在用户视野范围内，通过扫描提供统一服务接口的光标签也可以发现该服务。With continued reference to FIG. 23, more specifically, in step S1, when the user wishes to obtain certain services, the terminal device carried by the user may be used to perform image collection on the light tags associated with the service provider in the surrounding environment of the user. In one embodiment, each service provider may be assigned a specific light tag associated with it. For example, a light tag usually associated with a retail store can be installed in an area where customers can collect images, for example, the light tag is installed outside the retail store, such as on the door. The optical label can be integrated with the retail store's signboard. When the mobile phone is used to image the retail store's signboard, the information transmitted by the integrated optical label can be obtained. Of course, light labels can also be placed next to the signboards in retail stores. As another example, a light label associated with a retail store can also be set on a billboard that is easy for customers to find. Such a billboard does not have to be installed on the outer surface of the retail store, but can also be installed in a certain area around the retail store to be easily accessible to customers Any location you find, such as the exterior surface of a tall building in or near a retail store. In this way, when a user finds a service he wants to access within his or her field of vision, he can access the service by scanning the light tags associated with the service through his terminal device. In yet another embodiment, each light tag may be associated with one or more service providers. For example, a light label may be associated with a unified service interface through which one or more types of services provided by one or more service providers can be accessed. In this embodiment, such a light tag can be set at a location that is easily found or relatively prominent in the environment, and each service provider within a certain range nearby can register the services provided by it in the unified service interface. In this way, when a user wants to access a certain service or services in the vicinity, the user only needs to scan such a light tag. Even if the service you want to access is not within the user's field of vision, you can discover the service by scanning the light tags that provide a unified service interface.

在步骤S2，基于所采集的光标签图像获取与服务提供者相关的信息并确定终端设备的位置信息。在一些实施例中，光标签传递其标识信息。如上文提到的，光标签可以发布其标识信息，利用用户终端设备内置或集成的成像器件对光标签进行图像采集，解析所采集的光标签图像就能获取该光标签的标识信息。终端设备利用该标识信息查询例如图19的光标签网络服务器，就可以获得与该光标签关联的一个或多个服务提供者的信息。在一些实施例中，除了标识信息，光标签还可以编码和发布更多的数据内容，例如与该光标签关联的服务提供者的访问接口(例如零售店的购买页面的网址信息)等。这样，通过解析所采集的光标签图像也可以直接获取该光标签所关联的零售店的购买页面的网址。在光标签与一个或多个服务提供者关联的实施例中，光标签传递的信息可以包括例如统一服务接口的网址。这样，用户可以通过该统一服务接口发现并选择需要访问的一个或多个服务。In step S2, information related to the service provider is acquired based on the collected light tag image, and location information of the terminal device is determined. In some embodiments, the optical tag communicates its identification information. As mentioned above, the optical tag can publish its identification information, use the built-in or integrated imaging device of the user terminal device to image the optical tag, and analyze the collected optical tag image to obtain the identification information of the optical tag. The terminal device uses the identification information to query, for example, the optical label network server of FIG. 19, and can obtain information of one or more service providers associated with the optical label. In some embodiments, in addition to the identification information, the light tag can also encode and publish more data content, such as an access interface of a service provider associated with the light tag (for example, URL information of a purchase page of a retail store), and the like. In this way, the URL of the purchase page of the retail store associated with the light tag can also be directly obtained by analyzing the collected light tag image. In an embodiment where the light tag is associated with one or more service providers, the information passed by the light tag may include, for example, the URL of the unified service interface. In this way, the user can discover and select one or more services that need to be accessed through the unified service interface.

另外，如上文介绍的，可以基于所采集的光标签图像确定终端设备的位置信息。这里终端设备的位置信息可以包括终端设备与光标签的相对位置关系和/或终端设备的地理位置。例如，用配备有双目摄像头或深度摄像头的终端设备对光标签进行图像采集，基于所采集的图像就能获得该终端设备与光标签之间的相对距离，然后结合该终端设备采集图像时的朝向就能获得该终端设备与所采集的光标签之间相对位置关系。又例如，当用户使用终端设备上内置的普通摄像头对光标签进行图像采集时，可以根据所识别的光标签ID信息从服务器获得光标签的物理尺寸，然后基于所采集的光标签的图像的尺寸、拍摄到该光标签的图像时的焦距参数、光标签的物理尺寸，利用透镜物象公式和物像关系也可以获得该终端设备与光标签的相对距离，进而结合该终端设备采集图像时的朝向来获取终端设备与光标签之间相对位置关系。在上文提到的光标签网络中，每个光标签的地理位置可以是预先标定的，并可以保存在光标签网络服务器中。由此在获知光标签的地理位置时，可通过光标签的地理位置结合终端设备与光标签之间相对位置关系获得终端设备的地理位置。尽管通过GPS定位也能获取终端设备的大致地理位置对的估计，但常用的GPS定位的精度在几十米的范围内，且容易受天气状况或电磁干扰，并不能满足小范围精准定位的需求，另外,GPS定位没有高度信息，也没有用户的朝向信息。不同于通过GPS定位获取的终端设备的大概位置，上述依赖于在终端设备周围环境中光标签获取的终端设备的位置更准确，定位精度更高，且有包含高度信息的三维坐标信息，和拍摄设备的姿态信息。In addition, as described above, the position information of the terminal device may be determined based on the collected light tag image. Here, the location information of the terminal device may include a relative position relationship between the terminal device and the optical tag and / or a geographic location of the terminal device. For example, using a terminal device equipped with a binocular camera or a depth camera to perform image acquisition on a light tag, based on the collected images, the relative distance between the terminal device and the light tag can be obtained, and then combined with the terminal device when acquiring images Orientation can obtain the relative positional relationship between the terminal device and the collected optical tags. As another example, when a user uses an ordinary camera built in a terminal device to perform image collection on a light tag, the physical size of the light tag can be obtained from the server according to the identified light tag ID information, and then based on the size of the collected light tag image The focal distance parameter when the image of the optical label is captured, the physical size of the optical label, and the relative distance between the terminal device and the optical label can also be obtained by using the lens object image formula and the object image relationship, and then combining the orientation of the terminal device when collecting the image To obtain the relative positional relationship between the terminal device and the optical label. In the above-mentioned optical label network, the geographic location of each optical label may be pre-calibrated and stored in the optical label network server. Therefore, when the geographic position of the optical tag is known, the geographic position of the terminal device can be obtained by combining the geographic position of the optical tag with the relative position relationship between the terminal device and the optical tag. Although estimates of the approximate geographic location of the terminal device can also be obtained through GPS positioning, the accuracy of commonly used GPS positioning is in the range of tens of meters, and it is easily affected by weather conditions or electromagnetic interference, and cannot meet the needs of precise positioning in a small range. In addition, GPS positioning has no altitude information and no user orientation information. Different from the approximate position of the terminal device obtained through GPS positioning, the above-mentioned relying on the position of the terminal device obtained by the optical tag in the surrounding environment of the terminal device is more accurate, the positioning accuracy is higher, and there is three-dimensional coordinate information including height information, and shooting Device attitude information.

在步骤S3，根据所获取的信息生成服务请求并将其与终端设备位置信息发送给相应的服务提供者。例如当光标签传递的信息仅包括标识信息时，可基于所获取的光标签标识信息进一步查询预定的用于对光标签进行服务的服务器，以从服务器获取与该光标签相关的信息或服务，例如与该光标签关联的零售店的购买页面的网址、预先标定的该光标签的地理位置等。这样，顾客可以进入该购买页面进行选择相关商品进行支付以生成相关的商品订单。如果光标签传递的信息包括与该光标签关联的零售店的购买页面的网址，则顾客可以直接访问该网址来生成商品订单。其中与零售店关联的购买页面可以由位于零售店的零售管理服务器提供和维护，该零售管理服务器还用于接收所生成的商品订单并根据订单进行货物配送。与零售店关联的购买页面也可以由位于网络中的其他服务平台或网络平台提供和维护，零售店的零售管理服务器负责接收来自这些服务平台或网络平台提供的订单信息来进行货物配送。In step S3, a service request is generated based on the acquired information and sent to the corresponding service provider with the terminal device location information. For example, when the information transmitted by the optical label includes only identification information, based on the obtained optical label identification information, a predetermined server for servicing the optical label may be further queried to obtain information or services related to the optical label from the server. For example, the URL of the purchase page of the retail store associated with the light tag, the pre-calibrated geographic location of the light tag, and the like. In this way, the customer can enter the purchase page to select related products for payment to generate related product orders. If the information passed by the light tag includes the URL of the purchase page of the retail store associated with the light tag, the customer can directly access the URL to generate a product order. The purchase page associated with the retail store may be provided and maintained by a retail management server located at the retail store, and the retail management server is also used to receive the generated product order and distribute the goods according to the order. The purchase page associated with the retail store can also be provided and maintained by other service platforms or network platforms located in the network. The retail management server of the retail store is responsible for receiving order information from these service platforms or network platforms for goods distribution.

在光标签与一个或多个服务提供者相关联的一些实施例中，不同的服务提供者可能提供相同的服务，当用户通过中间服务平台提供的统一服务接口选定某个服务时，该中间服务平台可以根据下列中的一个或多个指标在可提供该服务的多个服务提供者之间选择其中一个来对用户进行响应：服务提供者与用户之间的距离、服务提供者当前待处理的服务请求的数量、服务提供者预估的服务等待时间、服务成本等等。在另外的示例中，中间服务平台也可以将来自用户的服务请求广播至可提供所请求服务的多个服务提供者，选择最快做出响应的服务提供者、服务成本最优的服务提供者、服务等待时间最短的服务提供者或者距离用户最近的服务提供者等等来对该用户提供相应服务。其中用户与服务提供者之间的支付流程可以利用现有的各种支付方式或支付平台来实现。In some embodiments where the light tag is associated with one or more service providers, different service providers may provide the same service. When a user selects a service through the unified service interface provided by the intermediate service platform, the intermediate The service platform can choose one of multiple service providers that can provide the service to respond to the user according to one or more of the following indicators: the distance between the service provider and the user, the service provider is currently pending Number of service requests, service wait time estimated by service provider, service cost, etc. In another example, the intermediate service platform can also broadcast service requests from users to multiple service providers that can provide the requested service, select the service provider that responds fastest, and the service provider with the best service cost. , The service provider with the shortest service waiting time or the service provider closest to the user, etc. to provide the corresponding service to the user. The payment process between the user and the service provider can be realized by using various existing payment methods or payment platforms.

在步骤S4，服务提供者根据接收到的服务请求和终端设备的位置信息来向用户提供所请求的服务。当收到的终端设备的位置信息为终端设备相对于光标签的位置时，服务提供者可以根据与其关联的光标签的地理位置和接收到的终端设备相对于该光标签的位置来确定终端设备的地理位置。服务提供者也可以根据服务提供者本身的地理位置、该服务提供者与其关联的光标签之间的相对位置以及接收到的终端设备相对于光标签的位置来确定终端设备的地理位置。终端设备的地理位置可以作为用户当前位置的估计，从而可针对该位置提供所请求的服务。仍以商品零售为例，零售店可设置成自动配货和取货的货品仓库形式，并采用专门的零售管理服务器来处理服务请求以便为用户提供相应服务。例如，在零售店门口设置自动出货的一个或多个通道，顾客可通过扫描视野内的光标签进入购买页面并生成订单，零售店的零售管理服务器收到商品订单后，可以从仓库中自动提取相应商品并将其传送到其中一个自动出货通道。顾客在下单后走到零售店门口，可根据订单号和验证码等从相应的出货通道取出自己购买的商品。在又一个示例中，为了更好的购物体验，零售管理服务器可以根据接收到顾客的终端设备相对于光标签的位置来确定下单的顾客的大致位置，并指示配送人员将顾客所订购的商品送至顾客身边。其中商品配送的范围与光标签最远识别距离有关，光标签的识别距离在一定程度上依赖于光标签的尺寸，因此可以根据实际需求设置与零售店关联的光标签的尺寸来确保在配送范围内配送时间尽量不超过5或10分钟。In step S4, the service provider provides the requested service to the user according to the received service request and the location information of the terminal device. When the received position information of the terminal device is the position of the terminal device relative to the optical label, the service provider may determine the terminal device according to the geographic location of the optical label associated with it and the position of the received terminal device relative to the optical label. Geographic location. The service provider may also determine the geographic location of the terminal device based on the geographic location of the service provider itself, the relative position between the service provider and its associated optical tag, and the position of the received terminal device relative to the optical tag. The geographic location of the terminal device can be used as an estimate of the user's current location, so that the requested service can be provided for that location. Still taking the retail of goods as an example, a retail store can be set up as a warehouse of goods that is automatically distributed and picked up, and a dedicated retail management server is used to process service requests in order to provide users with corresponding services. For example, one or more channels for automatic shipment are set up at the entrance of a retail store. Customers can enter the purchase page and generate an order by scanning the light tags in the field of view. After receiving the product order from the retail store's retail management server, it can automatically Pick up the item and send it to one of the automatic shipping channels. The customer walks to the entrance of the retail store after placing an order, and can take out the goods they purchased from the corresponding shipping channel according to the order number and verification code. In yet another example, for a better shopping experience, the retail management server may determine the approximate location of the customer who placed the order based on the position of the terminal device of the customer relative to the light tag, and instruct the delivery person to place the product ordered by the customer Delivered to customers. The range of product distribution is related to the farthest identification distance of the light label. The identification distance of the light label depends to some extent on the size of the light label, so the size of the light label associated with the retail store can be set according to actual needs to ensure the distribution range The delivery time should not exceed 5 or 10 minutes.

在又一个实施例中，为了方便配送人员进行配送，还可以预先对服务提供者周围环境进行3D建模，在所建立的3D环境模型中可以标定易识别的地标或其他标志物作为环境特征。如上文提到的，服务提供者可以根据与其关联的光标签的地理位置和接收到的终端设备相对于光标签的位置来确定终端设备的地理位置。在确定终端设备的地理位置之后，服务提供者可以根据终端设备的地理位置从预先建立的环境模型中提取与该地理位置关联的环境特征提供给配送人员，使其更容易识别顾客所在的位置。In another embodiment, in order to facilitate the delivery personnel to perform delivery, 3D modeling of the surrounding environment of the service provider may also be performed in advance, and easily-recognized landmarks or other landmarks may be marked as environmental features in the established 3D environment model. As mentioned above, the service provider may determine the geographic location of the terminal device based on the geographic location of the optical tag associated with it and the location of the received terminal device relative to the optical tag. After determining the geographic location of the terminal device, the service provider can extract the environmental features associated with the geographic location from a pre-established environmental model according to the geographic location of the terminal device and provide it to the delivery staff, making it easier to identify the location of the customer.

用户在发送服务请求之后可能在一定范围内继续移动，因此在又一个实施例中，在用户接收服务之前，还可以通过终端设备对其附近的光标签进行图像采集来更准确地确定终端设备的当前位置，并将重新确定的终端设备的当前位置以使得相应的服务提供者进行更准确的服务传送。终端设备的当前位置可以包括终端设备相对于所采集的光标签的位置和/或终端设备的地理位置。可以采用上文介绍的方法来确定终端设备的当前位置。例如，当用户在发出服务请求之后移动到某个位置，希望在该新的位置接收服务时，可以通过携带的终端设备对其附近可用的一个或多个光标签进行图像采集来确定终端设备与所采集的光标签之间的相对位置关系。如上文结合图19介绍光标签网络时所提到的，可以根据这些所识别的光标签的标识信息对光标签网络中预先设定的光标签服务器进行查询来获取与光标签相关的地理位置信息，然后根据所获得的与一个或多个光标签相关的地理位置信息和终端设备与光标签之间的相对位置关系来确定终端设备的地理位置，从而服务提供者可以根据终端设备的当前位置来进行更准确的服务传送。The user may continue to move within a certain range after sending the service request. Therefore, in another embodiment, before the user receives the service, the terminal device may also perform image collection on the nearby light tags to determine the terminal device ’s accuracy more accurately. The current location, and the current location of the terminal device will be re-determined to enable the corresponding service provider to perform more accurate service delivery. The current location of the terminal device may include the location of the terminal device relative to the collected light tags and / or the geographic location of the terminal device. The method described above can be used to determine the current location of the terminal device. For example, when a user moves to a location after sending a service request and wants to receive services at the new location, the terminal device can be used to carry out image collection of one or more optical tags available near it to determine whether the terminal device is related to The relative positional relationship between the collected light tags. As mentioned in the introduction of the optical label network in conjunction with FIG. 19 above, the preset optical label server in the optical label network can be queried to obtain the geographical location information related to the optical label according to the identification information of the identified optical labels. , And then determine the geographic location of the terminal device based on the obtained geographic location information related to one or more optical tags and the relative position relationship between the terminal device and the optical tag, so that the service provider can For more accurate service delivery.

在又一个实施例中，当用户在发送服务请求之后继续移动时，可以由服务提供者或中间服务平台通过视觉跟踪的方法识别发出服务请求的用户并实时跟踪该用户，及时将用户的当前位置提供给相应服务提供者以进行更准确的服务。例如，零售管理服务器可以利用安装在零售店外部的摄像装置识别和实时跟踪用户。当用户利用携带的终端设备对与零售店关联的光标签进行图像采集时，可以通过上文提到的反向定位确定该终端设备相对于所采集的光标签的位置，进而根据预先设定的光标签的地理位置可以估计出该终端设备的大致位置。由此可以利用零售店的摄像装置对用户的终端设备所在位置进行局域区域检查和识别。当用户利用终端设备扫描光标签时，通常会具有特定的举手拍照动作，由此可利用图像识别的技术可以在终端设备所在位置的局部区域内检测和识别这个动作，从而确定此时此刻在特定位置扫描光标签来下单的顾客。之后再利用目标跟踪方法对当前识别到的人进行跟踪，及时将顾客的当前位置提供给相关商品的配送人员所携带的终端设备。这样，即便用户下单了之后有小范围的移动也可以准确的获知当前的实际位置。配送人员在进行配送的时候就可以根据摄像头识别和跟踪的结果准确的确定下单的客户。零售管理服务器可以将跟踪的结果提供给由配送人员携带的终端设备上，使得配送人员可以及时了解顾客的位置。In another embodiment, when the user continues to move after sending the service request, the service provider or the intermediate service platform can identify the user who issued the service request through a visual tracking method and track the user in real time to timely update the user's current location. Provide to the corresponding service provider for more accurate services. For example, the retail management server may use a camera device installed outside the retail store to identify and track users in real time. When the user uses the terminal device that he carries to collect images of the light tags associated with the retail store, the position of the terminal device relative to the collected light tags can be determined through the reverse positioning mentioned above, and then based on the preset The geographic location of the optical tag can estimate the approximate location of the terminal device. In this way, the camera device of the retail store can be used to perform local area inspection and identification on the location of the user's terminal device. When a user uses a terminal device to scan a light tag, he or she usually has a specific raising hand to take a picture. Therefore, image recognition technology can be used to detect and recognize this action in a local area where the terminal device is located, so as to determine the time at this moment. Customers who scan light tags at specific locations to place orders. Then, the target tracking method is used to track the currently identified person, and the current position of the customer is provided to the terminal device carried by the delivery person of the related product in time. In this way, even if the user moves a small range after the order is placed, the current actual position can be accurately known. The delivery staff can accurately determine the customer who placed the order based on the results of the camera recognition and tracking. The retail management server can provide the tracking results to the terminal equipment carried by the delivery staff, so that the delivery staff can know the location of the customer in time.

在又一个实施例中，还可以在用户携带的终端设备上显示配送倒计时、配送人员的移动轨迹等信息，以使用户及时了解其订购的服务的配送情况。仍以商品零售为例，配送人员在拿到商品进行配送时，可以利用其携带的终端设备与零售管理服务器建立连接，发送商品对应的订单信息在服务器上进行注册，然后将其本身的地理位置信息不断实时地反馈给零售服务器。零售管理服务器可以根据配送人员的地理位置和顾客的地理位置来估计需要的配送时间。在顾客直接通过零售管理服务器提供的购买页面下单的情况下，零售管理服务器可以通过与顾客终端设备之间先前建立的连接将配送人员的实时位置和配送时间反馈给顾客的终端设备从而在其上显示配送人员的移动轨迹、配送倒计时等信息。在顾客通过网络中的其他服务平台或网购平台提供的购买页面下单时，零售店的零售管理服务器可以将配置人员的实时地理位置反馈给这些服务平台或网络平台，后者将配送人员的实时位置和估计的配送时间反馈给顾客的终端设备从而在其上显示配送人员的移动轨迹、配送倒计时等信息。In another embodiment, information such as the delivery countdown and the movement trajectory of the delivery personnel can be displayed on the terminal device carried by the user, so that the user can know the delivery status of the service ordered by him in time. Still taking the retail of goods as an example, when the delivery personnel get the goods for delivery, they can use the terminal equipment they carry to establish a connection with the retail management server, send the order information corresponding to the goods to register on the server, and then register their own geographical location Information is continuously fed back to the retail server in real time. The retail management server can estimate the required delivery time based on the geographic location of the delivery staff and the geographic location of the customer. In the case where the customer places an order directly through the purchase page provided by the retail management server, the retail management server can feedback the real-time location and delivery time of the delivery staff to the customer's terminal device through a previously established connection with the customer's terminal device, thereby Information such as the movement trajectory of the delivery staff and the countdown to delivery are displayed on the screen. When a customer places an order through a purchase page provided by another service platform or online shopping platform in the network, the retail management server of the retail store can feedback the real-time geographic location of the configuration staff to these service platforms or network platforms, which will The location and estimated delivery time are fed back to the customer's terminal device to display information such as the movement trajectory of the delivery staff, the delivery countdown, and so on.

在又一个实施例中，还提供了一种基于光标签的服务提供***，包括在用户携带的终端设备上运行的光标签客户端、与服务提供者关联的光标签和服务器。其中光标签客户端可以对与服务提供者关联的光标签进行图像采集；基于所采集的光标签图像获取与服务提供者相关的信息并确定终端设备的位置信息；根据所获取的与服务提供者相关的信息生成服务请求，并将所述服务请求和终端设备的位置信息发送给与相应服务提供者关联的服务器。与服务提供者关联的服务器可以如上文介绍的样基于收到的服务请求和所述位置信息来提供所请求的服务。在又一个实施例中，该光标签客户端还可以对用户当前位置附近的光标签进行图像采集，并基于当前采集的光标签图像确定终端设备的当前位置；将重新确定的终端设备的当前位置发送给与相应服务提供者关联的服务器。相应地，服务器还可以被配置为根据该重新确定的终端设备的当前位置来更准确地提供所请求的服务。In yet another embodiment, a light label-based service providing system is also provided, including a light label client running on a terminal device carried by a user, a light label and a server associated with the service provider. Among them, the light tag client can perform image collection on the light tags associated with the service provider; obtain the information related to the service provider and determine the location information of the terminal device based on the collected light tag images; and according to the obtained information with the service provider The related information generates a service request, and sends the service request and the location information of the terminal device to a server associated with a corresponding service provider. The server associated with the service provider may provide the requested service based on the received service request and the location information as described above. In yet another embodiment, the light tag client may further perform image collection on a light tag near the user's current position, and determine the current position of the terminal device based on the currently collected light tag image; the current position of the terminal device to be re-determined Sent to the server associated with the corresponding service provider. Accordingly, the server may be further configured to provide the requested service more accurately according to the re-determined current location of the terminal device.

通过上述实施例可以看出，本发明提供了高效快捷的服务交互方式，简化了用户购物消费、获得服务的交互过程，能在短时间内给用户及时提供服务，满足其即时产生的服务需求，使其能随时随地享受到实时的服务。It can be seen from the foregoing embodiments that the present invention provides an efficient and efficient service interaction method, simplifies the interactive process of user purchase and service acquisition, and can provide users with services in a short time and meet their immediate service requirements. It can enjoy real-time services anytime, anywhere.

另外，申请人已经针对光标签提交了多个专利申请，下列申请的内容也通过引用全部包含于本申请中：CN2017113749159,CN2017113747312,CN2017113721384,CN2017113740421,CN2017113752749,CN2018104352309,CN201810435207X,CN2018104351838,PCT/CN2017/099642,PCT/CN2017/099645。In addition, the applicant has submitted multiple patent applications for optical tags, and the contents of the following applications are also included in this application by reference: CN2017113749159, CN2017113747312, CN2017113721384, CN2017113740421, CN2017113752749, CN2018104352309, CN201810435207X, CN2018104351838, PCT / CN2017 / 099642 , PCT / CN2017 / 099645.

本文中针对“各个实施例”、“一些实施例”、“一个实施例”、或“实施例”等的参考指代的是结合所述实施例所描述的特定特征、结构、或性质包括在至少一个实施例中。因此，短语“在各个实施例中”、“在一些实施例中”、“在一个实施例中”、或“在实施例中”等在整个本文中各处的出现并非必须指代相同的实施例。此外，特定特征、结构、或性质可以在一个或多个实施例中以任何合适方式组合。因此，结合一个实施例中所示出或描述的特定特征、结构或性质可以整体地或部分地与一个或多个其他实施例的特征、结构、或性质无限制地组合，只要该组合不是非逻辑性的或不能工作。本文中出现的类似于“根据A”或“基于A”的表述意指非排他性的，也即，“根据A”可以涵盖“仅仅根据A”，也可以涵盖“根据A和B”，除非特别声明或者根据上下文明确可知其含义为“仅仅根据A”。在本申请中为了清楚说明，以一定的顺序描述了一些示意性的操作步骤，但本领域技术人员可以理解，这些操作步骤中的每一个并非是必不可少的，其中的一些步骤可以被省略或者被其他步骤替代。这些操作步骤也并非必须以所示的方式依次执行，相反，这些操作步骤中的一些可以根据实际需要以不同的顺序执行，或者并行执行，只要新的执行方式不是非逻辑性的或不能工作。References herein to “individual embodiments”, “some embodiments”, “one embodiment”, or “an embodiment” and the like refer to specific features, structures, or properties described in connection with the embodiments are included in In at least one embodiment. Thus, the appearances of the phrases "in various embodiments", "in some embodiments", "in one embodiment", or "in embodiments", etc. throughout this document are not necessarily referring to the same implementation example. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Thus, a particular feature, structure, or property shown or described in connection with one embodiment can be combined, in whole or in part, with a feature, structure, or property of one or more other embodiments without limitation, as long as the combination is not a non- Logical or not working. Expressions similar to "based on A" or "based on A" appearing herein are meant to be non-exclusive, that is, "based on A" may cover "based on A only" or "based on A and B" unless specifically stated It is stated or clear from the context that its meaning is "based only on A". In the present application, for the purpose of clear description, some schematic operation steps are described in a certain order, but those skilled in the art can understand that each of these operation steps is not indispensable, and some of the steps can be omitted. Or replaced by other steps. These operation steps do not have to be performed sequentially in the manner shown. Instead, some of these operation steps can be performed in a different order according to actual needs, or in parallel, as long as the new execution mode is not non-logical or cannot work.

虽然本发明已经参照优选实施例进行了描述，然而本发明并非局限于这里所描述的实施例，在不脱离本发明范围的情况下还包括所做出的各种改变以及变化。Although the present invention has been described with reference to preferred embodiments, the present invention is not limited to the embodiments described herein, and includes various changes and modifications made without departing from the scope of the present invention.

Claims

一种基于光标签的服务提供方法，包括：A light tag-based service providing method includes:

S1)通过用户携带的终端设备对与服务提供者关联的光标签进行图像采集；S1) Perform image collection on the optical tag associated with the service provider through the terminal device carried by the user;

S2)基于所采集的光标签图像获取与服务提供者相关的信息并确定终端设备相对于光标签的位置；S2) Obtaining information related to the service provider based on the collected light tag image and determining the position of the terminal device relative to the light tag;

S3)根据所获取的与服务提供者相关的信息生成服务请求，并将所述服务请求和所述终端设备的位置信息发送给相应的服务提供者，其中所述终端设备的位置信息是基于终端设备相对于光标签的位置来确定的；S3) Generate a service request according to the obtained information related to the service provider, and send the service request and the location information of the terminal device to the corresponding service provider, where the location information of the terminal device is based on the terminal The position of the device relative to the light tag is determined;

S4)由服务提供者基于收到的服务请求和所述终端设备的位置信息来提供所请求的服务。S4) The requested service is provided by the service provider based on the received service request and the location information of the terminal device.
根据权利要求1所述的方法，其中所述光标签与一个或多个服务提供者相关联。The method of claim 1, wherein the light tag is associated with one or more service providers.
根据权利要求2所述的方法，还包括：The method of claim 2, further comprising:

将所述服务请求发送给可提供所请求的服务的多个服务提供者；Sending the service request to a plurality of service providers that can provide the requested service;

选择其中一个服务提供者来为用户提供所请求的服务。Select one of the service providers to provide the requested service to the user.
根据权利要求1所述的方法，在S4)之前还包括：The method according to claim 1, before S4), further comprising:

利用所述终端设备对用户当前位置附近的光标签进行图像采集以确定终端设备相对于该光标签的位置并将其作为新的位置信息发送给服务提供者；Using the terminal device to perform image collection on a light tag near the user's current location to determine the position of the terminal device relative to the light tag and send it to the service provider as new location information;

由服务提供者响应于收到自终端设备发送的新的位置信息重新确定终端设备的当前位置。The current location of the terminal device is re-determined by the service provider in response to receiving new location information sent from the terminal device.
根据权利要求1-4中任一项所述的方法，其中所述终端设备的位置信息包括终端设备相对于所采集的光标签的位置和/或终端设备的地理位置。The method according to any one of claims 1-4, wherein the location information of the terminal device comprises a location of the terminal device relative to the collected light tag and / or a geographic location of the terminal device.
根据权利要求5所述的方法，其中终端设备的地理位置是根据所述终端设备相对于光标签的位置以及预先标定的该光标签的地理位置来确定的。The method according to claim 5, wherein the geographical position of the terminal device is determined according to a position of the terminal device relative to the optical tag and a pre-calibrated geographical position of the optical tag.
根据权利要求1所述的方法，其中在步骤S3)所述终端设备的位置信息为终端设备相对于所采集的光标签的位置，以及在步骤S4)还包括根据接收到的所述终端设备相对于光标签的位置以及预先标定的光标签的地理位置确定所述终端设备的地理位置，以便向其提供所请求的服务。The method according to claim 1, wherein the position information of the terminal device in step S3) is a position of the terminal device relative to the collected light tag, and in step S4) further comprises relative to the received terminal device. The geographic location of the terminal device is determined based on the location of the optical tag and the geographic location of the pre-calibrated optical tag, so as to provide the requested service to it.
根据权利要求1所述的方法，还包括：The method of claim 1, further comprising:

由服务提供者利用摄像装置基于终端设备的位置信息识别发出所述服务请求的用户，并利用目标跟踪方法对所识别的用户进行实时跟踪；The service provider uses the camera to identify the user who issued the service request based on the location information of the terminal device, and uses the target tracking method to track the identified user in real time;

利用跟踪的结果来调整该用户所请求的服务的提供。Use the results of the tracking to adjust the provision of the service requested by the user.
一种基于光标签的服务提供方法，包括：A light tag-based service providing method includes:

S1)通过用户携带的终端设备对与服务提供者关联的光标签进行图像采集；S1) Perform image collection on the optical tag associated with the service provider through the terminal device carried by the user;

S2)基于所采集的光标签图像获取与服务提供者相关的信息；S2) Obtaining information related to the service provider based on the collected light tag image;

S3)根据所获取的与服务提供者相关的信息生成服务请求，并将所述服务请求发送给相应的服务提供者；S3) Generate a service request according to the obtained information related to the service provider, and send the service request to the corresponding service provider;

S4)通过所述终端设备对用户周围一个或多个光标签进行图像采集，基于当前采集的图像确定终端设备的当前位置并将其发送给相应的服务提供者；S4) using the terminal device to perform image acquisition on one or more light tags around the user, determine the current position of the terminal device based on the currently acquired image, and send it to the corresponding service provider;

S5)服务提供者基于收到的服务请求和所述当前位置来提供所请求的服务。S5) The service provider provides the requested service based on the received service request and the current location.
根据权利要求9所述的方法，其中所述光标签与一个或多个服务提供者相关联。The method of claim 9, wherein the light tag is associated with one or more service providers.
根据权利要求10所述的方法，还包括：The method of claim 10, further comprising:

将所述服务请求发送给可提供所请求的服务的多个服务提供者；Sending the service request to a plurality of service providers that can provide the requested service;

选择其中一个服务提供者来为用户提供所请求的服务。Select one of the service providers to provide the requested service to the user.
根据权利要求9-11中任一项所述的方法，在步骤S4)所述一个或多个光标签包括与服务提供者关联的光标签或者用户当前位置附近的其他光标签所述其他光标签为用户当前位置附近的光标签。The method according to any one of claims 9-11, in step S4), the one or more light tags include a light tag associated with a service provider or other light tags near a user's current location. The other light tags A light tag near the user's current location.
根据权利要求9-11中任一项所述的方法，其中所述终端设备的当前位置包括终端设备相对于所采集的光标签的位置和/或终端设备的地理位置。The method according to any one of claims 9-11, wherein the current location of the terminal device comprises a location of the terminal device relative to the collected light tag and / or a geographic location of the terminal device.
根据权利要求9-11中任一项所述的方法，在步骤S4)基于当前采集的图像确定终端设备的当前位置包括：The method according to any one of claims 9-11, in step S4) determining the current position of the terminal device based on the currently acquired image comprises:

识别当前采集的光标签的标识信息；Identifying identification information of the currently collected light tags;

基于所识别的标识信息从预先设定的光标签服务器获取与该光标签相关的地理位置信息；Obtaining geographic location information related to the optical tag from a preset optical tag server based on the identified identification information;

基于当前采集的光标签图像确定所述终端设备相对于该光标签的位置；Determining the position of the terminal device with respect to the light tag based on the currently collected light tag image;

根据所述终端设备相对于该光标签的位置以及所获得的与该光标签相关的地理位置信息确定所述终端设备的地理位置作为该终端设备的当前位置。The geographical position of the terminal device is determined as the current position of the terminal device according to the position of the terminal device relative to the optical label and the obtained geographical position information related to the optical label.
一种基于光标签的服务提供***，包括在用户携带的终端设备上运行的光标签客户端、与服务提供者关联的光标签和服务器，其中：An optical label-based service providing system includes an optical label client running on a terminal device carried by a user, an optical label and a server associated with a service provider, wherein:

所述光标签客户端被配置为：The light label client is configured to:

对与服务提供者关联的光标签进行图像采集；Image collection of light tags associated with service providers;

基于所采集的光标签图像获取与服务提供者相关的信息并确定终端设备相对于光标签的位置；Obtaining information related to the service provider based on the collected light tag image and determining the position of the terminal device relative to the light tag;

根据所获取的与服务提供者相关的信息生成服务请求，并将所述服务请求和所述终端设备相对于光标签的位置发送给相应的服务提供者；Generating a service request according to the obtained information related to the service provider, and sending the service request and the position of the terminal device with respect to the optical tag to the corresponding service provider;

所述服务器被配置为：The server is configured to:

根据收到的终端设备相对于光标签的位置确定终端设备的当前位置；Determining the current position of the terminal device according to the received position of the terminal device relative to the optical tag;

基于收到的服务请求和所述当前位置来提供所请求的服务。The requested service is provided based on the received service request and the current location.
根据权利要求15所述的***，所述光标签客户端还被配置为：The system of claim 15, the light label client is further configured to:

对用户当前位置附近的光标签进行图像采集以确定终端设备相对于该光标签的位置并将其作为新位置发送给服务提供者；以及Image collection of a light tag near the user's current location to determine the position of the terminal device relative to the light tag and send it to the service provider as a new location; and

所述服务器还被配置为：The server is also configured to:

响应于收到自终端设备发送的新位置重新确定终端设备的当前位置。The current location of the terminal device is re-determined in response to receiving the new location sent from the terminal device.
根据权利要求15或16所述的***，所述服务器还被配置为：The system according to claim 15 or 16, the server is further configured to:

将请求发送给可提供所请求的服务的多个服务提供者；Send requests to multiple service providers who can provide the requested service;

选择其中一个服务提供者来为用户提供所请求的服务。Select one of the service providers to provide the requested service to the user.
一种基于光标签的服务提供***，包括在用户携带的终端设备上运行的光标签客户端、与服务提供者关联的光标签和服务器，其中：An optical label-based service providing system includes an optical label client running on a terminal device carried by a user, an optical label and a server associated with a service provider, wherein:

所述光标签客户端被配置为：The light label client is configured to:

对与服务提供者关联的光标签进行图像采集；Image collection of light tags associated with service providers;

基于所采集的光标签图像获取与服务提供者相关的信息；Obtaining information related to the service provider based on the collected light tag images;

根据所获取的与服务提供者相关的信息生成服务请求，并将所述服务请求发送给相应的服务提供者；和Generating a service request based on the obtained information related to the service provider, and sending the service request to the corresponding service provider; and

对用户周围一个或多个光标签进行图像采集，基于当前采集的图像确定终端设备的当前位置并将其发送给相应的服务提供者；以及Image capture one or more light tags around the user, determine the current location of the terminal device based on the currently captured image, and send it to the corresponding service provider; and

所述服务器被配置为：The server is configured to:

基于收到的服务请求和所述当前位置来提供所请求的服务。The requested service is provided based on the received service request and the current location.
根据权利要求18所述的***，其中所述光标签客户端基于当前采集的图像确定终端设备的当前位置包括：The system according to claim 18, wherein the light tag client determining the current position of the terminal device based on the currently acquired image comprises:

识别当前采集的光标签的标识信息；Identifying identification information of the currently collected light tags;

基于所识别的标识信息从预先设定的光标签服务器获取与该光标签相关的地理位置信息；Obtaining geographic location information related to the optical tag from a preset optical tag server based on the identified identification information;

基于当前采集的光标签图像确定所述终端设备相对于该光标签的位置；Determining the position of the terminal device with respect to the light tag based on the currently collected light tag image;

根据所述终端设备相对于该光标签的位置以及所获得的与该光标签相关的地理位置信息确定所述终端设备的地理位置作为该终端设备的当前位置。The geographical position of the terminal device is determined as the current position of the terminal device according to the position of the terminal device relative to the optical label and the obtained geographical position information related to the optical label.
一种计算设备，包括处理器和存储器，所述存储器中存储有计算机程序，所述计算机程序在被所述处理器执行时能够用于实现权利要求1-14中任一项所述的方法。A computing device includes a processor and a memory, and the memory stores a computer program that can be used to implement the method according to any one of claims 1 to 14 when executed by the processor.
一种存储介质，其中存储有计算机程序，所述计算机程序在被执行时能够用于实现权利要求1-14中任一项所述的方法。A storage medium having stored therein a computer program that, when executed, can be used to implement the method according to any one of claims 1-14.