WO2023075383A1 - Method and system for providing advertisement on unmanned vehicle - Google Patents

Method and system for providing advertisement on unmanned vehicle Download PDF

Info

Publication number
WO2023075383A1
WO2023075383A1 PCT/KR2022/016398 KR2022016398W WO2023075383A1 WO 2023075383 A1 WO2023075383 A1 WO 2023075383A1 KR 2022016398 W KR2022016398 W KR 2022016398W WO 2023075383 A1 WO2023075383 A1 WO 2023075383A1
Authority
WO
WIPO (PCT)
Prior art keywords
advertisement
unmanned mobile
recipient
unmanned
recipients
Prior art date
Application number
PCT/KR2022/016398
Other languages
French (fr)
Korean (ko)
Inventor
김현곤
사지원
강기혁
이상민
Original Assignee
(주)뉴빌리티
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by (주)뉴빌리티 filed Critical (주)뉴빌리티
Publication of WO2023075383A1 publication Critical patent/WO2023075383A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0251—Targeted advertisements
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J11/00—Manipulators not otherwise provided for
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J5/00—Manipulators mounted on wheels or on carriages
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J5/00—Manipulators mounted on wheels or on carriages
    • B25J5/007—Manipulators mounted on wheels or on carriages mounted on wheels
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
    • B25J9/1664—Programme controls characterised by programming, planning systems for manipulators characterised by motion, path, trajectory planning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0241—Advertisements
    • G06Q30/0242—Determining effectiveness of advertisements

Definitions

  • the present invention relates to a service providing method and system in an unmanned mobile vehicle, and more particularly, to a method and system for providing advertisements to advertisement recipients through an unmanned mobile vehicle.
  • An unmanned mobile body refers to a mobile body capable of recognizing an external environment, determining a situation by itself, moving, and performing work when necessary. These unmanned mobile vehicles have the ability to detect and recognize the external environment or their own momentum, the ability to move themselves and other objects, and the ability to maneuver and perform missions according to a given plan, and to interact with operators for this purpose. A means is provided so that the operator can remotely control the unmanned mobile vehicle.
  • the unmanned mobile vehicle can be in charge of various guidance services, assistance, security, and public order maintenance tasks on behalf of people in places with a large floating population. It is also a reality that is being considered in the industry.
  • the present invention has been devised in accordance with the above-mentioned needs, and an object of the present invention is to provide customized advertisement contents for each advertisement recipient identified while an unmanned mobile vehicle is moving by utilizing a deep learning-based object recognition algorithm.
  • a method for providing an advertisement in an unmanned mobile vehicle includes acquiring location information of the unmanned mobile vehicle; acquiring map data corresponding to the acquired location information; obtaining image data around the unmanned vehicle; obtaining a route to a destination from the obtained location information; moving based on the acquired path; identifying the advertisement recipient from the obtained image data, if there is an advertisement recipient while moving along the path; and displaying an advertisement for each of the identified advertisement recipients.
  • the obtaining of a route from the obtained location information to the destination may include: confirming existence of a group of advertisement recipients near the location information of the unmanned mobile vehicle; setting the location of the advertisement recipient group as the destination; and calculating a route to the destination from the location information of the unmanned mobile vehicle.
  • the step of confirming the existence of the advertisement acceptor group may include obtaining image data from cameras located within a predetermined radius based on location information of the unmanned mobile object on the map data; identifying the advertisement recipients within the image data through image analysis of the obtained image data; and if the number of the identified advertisement recipients is equal to or greater than a preset number, determining the advertisement recipients as the advertisement recipient group.
  • step of calculating a route from the location information of the unmanned mobile vehicle to the destination if there are a plurality of advertisement acceptor groups, setting an advertisement acceptor group other than the advertisement acceptor group set as the destination as a stopover of the route. ; more includes
  • the advertisement recipients are determined by the advertiser as targets to accept advertisements, and the obtained image data is classified into any one of men, women, adults, and children using a machine learning-based learning model characterized by being
  • the method further includes controlling the movement of the unmanned mobile body according to the movement direction and speed of the advertisement recipient when the advertisement recipient is on the move as a result of the video analysis of the advertisement recipient.
  • the method further includes moving the unmanned mobile body to a location where the advertisement acceptor is located, if there is an advertisement acceptor while moving along the path.
  • the method further includes providing advertisement contents set to be provided by the advertiser for each of the classified advertisement recipients.
  • the receiving of feedback on the advertisement content from the advertisement receiver may include: obtaining a gaze direction of the advertisement receiver through image analysis obtained with respect to the advertisement receiver; analyzing the direction of the gaze of the advertisement recipient; and if the gaze of the advertisement receiver is watching the advertisement provided by the unmanned mobile vehicle, the advertisement is continuously provided to the advertisement receiver for a predetermined time, and when the predetermined time expires, the additional service is provided to the advertisement receiver. It includes; providing;
  • An advertisement providing system in an unmanned mobile vehicle for achieving the above object includes a communication unit communicating with an external server; display unit; a camera acquiring image data of the outside of the unmanned vehicle; a location information acquisition unit acquiring location information of the unmanned mobile vehicle; a memory for storing a learning-based advertisement recipient classification model and map data corresponding to the obtained location information; a driving unit controlling a moving direction and a moving speed of the unmanned mobile body by a driving signal; and obtaining a route from the obtained location information to a destination, generating the driving signal to move the unmanned vehicle based on the obtained route, and if there is an advertisement acceptor while moving on the route, the advertisement acceptor and a processor configured to identify the advertisement recipients from the acquired image data using a classification model and control the display unit to display advertisements for each of the identified advertisement recipients.
  • the external server checks the presence of a group of advertisement recipients near the location information of the unmanned mobile body, sets the location of the group of advertisement recipients as the destination, and calculates a route from the location information of the unmanned mobile body to the destination.
  • a path setting unit that calculates and transmits the calculated path to the unmanned mobile vehicle through the communication unit;
  • an image acquiring unit acquiring the image data from cameras located within a predetermined radius based on location information of the unmanned mobile body or the unmanned mobile body on the map data;
  • a learning data generation unit generating learning data for classifying the advertisement recipients using image data acquired from the unmanned mobile vehicle;
  • an advertisement receiver classification model generation unit generating the advertisement receiver classification model using the generated learning data and providing the advertisement receiver classification model to the unmanned mobile vehicle through a network;
  • an image analyzer configured to identify the advertisement recipients in the image data through video analysis of the acquired image data, and to determine the advertisement recipients as the advertisement recipient group if the number of the identified advertisement recipients is greater than or equal to a preset number; includes
  • the route setting unit may set an advertisement acceptor group other than the advertisement acceptor group set as the destination as a stopover of the route if the advertisement acceptor group is plural.
  • the advertisement recipients are determined by the advertiser as targets to accept advertisements, and the obtained image data is classified into any one of men, women, adults, and children by using a machine learning-based learning model. characterized by being
  • the processor generates the driving signal to control the movement of the unmanned mobile body according to the movement direction and speed of the advertisement recipient when the advertisement recipient is moving as a result of the video analysis of the advertisement recipient.
  • the processor may generate the driving signal for moving the unmanned mobile body to a location where the advertisement acceptor is located, if the advertisement acceptor is present while moving on the path.
  • the processor may control the display unit to provide advertisement contents set to be provided by the advertiser for each of the classified advertisement recipients.
  • the processor is characterized in that it receives feedback on the advertising content from the advertisement recipient, and provides a predetermined additional service to the advertisement recipient according to the received feedback, wherein the additional service includes video content viewing, It includes at least one of an Internet service and purchase information for the advertising content.
  • the processor obtains a gaze direction of the advertisement recipient through image analysis obtained with respect to the advertisement recipient, analyzes the direction of the gaze of the advertisement recipient, and determines whether the gaze of the advertisement recipient is provided by the unmanned mobile body. If the user is watching the advertisement, the advertisement is continuously provided to the advertisement receiver for a predetermined time period, and when the predetermined time period ends, the supplementary service is provided to the advertisement receiver.
  • customized advertisement contents can be provided for each advertisement recipient identified through a deep learning-based object recognition algorithm while the unmanned vehicle is moving, so that advertisers can easily achieve the desired advertising effect. there is.
  • FIG. 1 is a diagram showing an advertisement providing system in an unmanned mobile vehicle according to an embodiment of the present invention
  • FIG. 2 is a block diagram of an unmanned mobile vehicle according to an embodiment of the present invention.
  • FIG. 3 is a block diagram of a server according to an embodiment of the present invention.
  • FIG. 4 is a flowchart illustrating a method of providing advertisements in an unmanned mobile vehicle according to an embodiment of the present invention
  • FIG. 5 is a flowchart of an advertisement providing method between an unmanned mobile vehicle and a server according to another embodiment of the present invention.
  • step S150 of FIG. 4 is a method flowchart for explaining step S150 of FIG. 4 in detail
  • step S165 of FIG. 4 is a method flowchart for explaining step S165 of FIG. 4 in detail
  • FIG. 8 is a flowchart of a method for providing an advertisement for an unmanned mobile vehicle according to another embodiment of the present invention.
  • FIG. 9 is a flowchart of a method for providing advertisements in a server according to an embodiment of the present invention.
  • FIG. 10 is a flowchart of a method for providing an advertisement for an unmanned mobile vehicle according to another embodiment of the present invention.
  • block diagrams herein are to be understood as representing conceptual views of exemplary circuits embodying the principles of the present invention.
  • all flowcharts, state transition diagrams, pseudo code, etc. are meant to be tangibly represented on computer readable media and represent various processes performed by a computer or processor, whether or not the computer or processor is explicitly depicted. It should be.
  • processors may be provided using dedicated hardware as well as hardware capable of executing software in conjunction with appropriate software.
  • the functionality may be provided by a single dedicated processor, a single shared processor, or a plurality of separate processors, some of which may be shared.
  • DSP digital signal processor
  • ROM read-only memory
  • RAM random access memory
  • non-volatile memory Other hardware for the governor's use may also be included.
  • components expressed as means for performing the functions described in the detailed description include, for example, a combination of circuit elements performing the functions or all types of software including firmware/microcode, etc. It is intended to include any method that performs the function of performing the function, combined with suitable circuitry for executing the software to perform the function. Since the invention defined by these claims combines the functions provided by the various enumerated means and is combined in the manner required by the claims, any means capable of providing such functions is equivalent to that discerned from this specification. should be understood as
  • first and second used in this specification may be used to describe various components, but the components should not be limited by the terms. These terms are only used for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element, without departing from the scope of the present invention.
  • FIG. 1 is a diagram illustrating an advertisement providing system in an unmanned mobile vehicle according to an embodiment of the present invention.
  • an advertisement providing system in an unmanned mobile vehicle includes an unmanned mobile vehicle 100, an access point (AP) 105, a first network 110, a camera 115, a first 2 network 120 and server 150.
  • AP access point
  • the unmanned mobile body 100 acquires location information, and when map data corresponding to the obtained location information is obtained, it travels a route determined from the obtained location information to a destination on the obtained map data. While doing so, it is possible to acquire surrounding image data.
  • the unmanned mobile body 100 analyzes the obtained image data using a machine learning-based learning model while moving on the path, and as a result of the analysis of the performed image data, the unmanned mobile body 100's surroundings , and identify advertisement recipients existing in the vicinity. In addition, the unmanned mobile body 100 may provide advertisements for each of the identified advertisement recipients.
  • the unmanned mobile vehicle 100 can access the AP 105 connected to the server 150 through a wireless network, and the AP 105 can be connected to the server 150 through the first network 110.
  • the unmanned mobile body 100 can access the AP 105 using various wireless access standards such as Wi-Fi (Wireless Fidelity) communication, cellular-based mobile communication such as 4G/5G, and NFC (Near Field Communication).
  • Wi-Fi Wireless Fidelity
  • cellular-based mobile communication such as 4G/5G
  • NFC Near Field Communication
  • the unmanned mobile body 100 may transmit and receive various types of data to and from the server 150 through the AP 105 .
  • the unmanned vehicle 100 may transmit acquired image data, feedback information of advertisement recipients, and sensing information around a route to the server 150, and from the server 150, route information, Destination information, a learning model algorithm for classifying and identifying advertisement recipients, advertisement service request information, advertisement data, and the like may be received through the AP 105 .
  • the server 150 may obtain location information and surrounding image data of the unmanned vehicle 100 through the AP 105, route information, destination information, criteria for classifying advertisement recipients, and classified advertisements. Advertisements provided for each recipient, route information, and the like may be provided through the AP 105 .
  • the server 150 when the server 150 according to an embodiment of the present invention obtains location information of the current unmanned mobile vehicle 100 from the unmanned mobile vehicle 100, the camera located within a predetermined radius from the obtained location information of the unmanned mobile vehicle 100. Image data captured in the fields 115 may be obtained.
  • the server 150 according to an embodiment of the present invention may identify advertisement recipients through video analysis of image data obtained from the cameras 115, and if the number of the identified advertisement recipients is greater than or equal to a preset number, the Ad receivers may be determined as an advertisement acceptor group, and the location of the advertisement acceptor group may be guided to a stopover or destination of the unmanned mobile vehicle 100 .
  • the server 150 may set the unmanned vehicle 100 to provide different advertisements for each identified advertisement recipient.
  • the unmanned vehicle 100 may be controlled to provide advertisements related to men's accessories such as razors, sports goods, men's perfume, men's watches, men's clothing, and the like.
  • the unmanned vehicle 100 may be controlled to provide advertisements related to cosmetics, women's perfume, women's accessories, women's clothing, and the like.
  • the unmanned mobile vehicle 100 acquires route information and destination information for movement from the server 150, but this is only an exemplary embodiment. It is also possible to move according to route and destination information previously stored in (100).
  • FIG. 2 is a block diagram of an unmanned mobile body 200 according to an embodiment of the present invention.
  • an unmanned vehicle 200 includes a communication unit 205, a display unit 210, a camera 215, a location information obtaining unit 220, a memory 225, and a driving unit 230. ), a processor 235 and a sensor unit 240 may be included.
  • the communication unit 205 communicates with the external server 150 according to a predetermined wireless access standard, and the display unit 210 may display advertisements to be provided to advertisement recipients.
  • the display unit 210 may be attached to the front, rear, left, and right sides of the unmanned mobile body 200, respectively, and it is preferable that the height of the display unit 210 be adjusted according to the gaze or eye level of the advertisement receiver in order to effectively deliver the advertisement to advertisement receivers.
  • the display unit 210 according to an embodiment of the present invention may be composed of a Liquid Crystal Display (LCD), Light Emitting Diode (LED), Organic Light Emitting Diode (OLED), or the like, and may sense a touch input of an ad receiver. A touch sensor may also be included.
  • the camera 215 includes an image sensor that converts light energy received through a lens into electrical energy, and converts external objects around the unmanned mobile body 200 into image data.
  • the location information acquisition unit 220 may include a receiver that receives satellite signals such as GPS (Global Positioning System) and GLONASS (Global Navigation Satellite) to measure a location on the earth, and measures signal strength received from neighboring base stations. Thus, the relative location from the base station may be measured, and the measured location information may be transmitted to the processor 235.
  • satellite signals such as GPS (Global Positioning System) and GLONASS (Global Navigation Satellite)
  • the memory 225 may store a learning-based advertisement recipient classification model, map data corresponding to the obtained location information, and image data obtained through the camera 215 .
  • the memory 225 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , an optical disk, and at least one type of storage medium.
  • the driver 230 can control the moving direction and moving speed of the unmanned mobile body 200 by a driving signal, and a steering means for controlling the moving direction of the unmanned mobile body 200 and acceleration capable of controlling the moving speed It may include an engine or an electric motor that provides a power source capable of moving the means and deceleration means and the unmanned mobile body 200 .
  • the processor 235 obtains a route from the obtained location information to a destination, generates the driving signal to move the unmanned vehicle based on the obtained route, and if there is an advertisement receiver while moving on the route, the processor 235 ,
  • the advertisement receiver is identified from the obtained image data using the advertisement receiver classification model, and the display unit 210 is controlled to display an advertisement for each identified advertisement receiver.
  • the processor 235 controls the movement of the unmanned mobile body 200 according to the movement direction and speed of the advertisement recipient when the advertisement recipient is moving as a result of video analysis of the advertisement recipient.
  • a drive signal can be generated.
  • the processor 235 may generate the driving signal for moving the unmanned mobile body 200 to a location where the advertisement acceptor is present while moving along the path.
  • the processor 235 may control the display unit 210 to provide advertisement contents set to be provided by the advertiser for each of the classified advertisement recipients.
  • the processor 235 may receive feedback on the advertisement content from the advertisement receiver, and control the display unit 210 to provide a predetermined additional service to the advertisement receiver according to the received feedback.
  • the supplementary service may include at least one of viewing video content, Internet service, and purchase information for the advertising content.
  • the processor 235 obtains the gaze direction of the advertisement recipient through image analysis obtained with respect to the advertisement recipient, analyzes the direction of the gaze of the advertisement recipient, and determines whether the gaze of the advertisement recipient is the unmanned mobile body ( 200), the advertisement is continuously provided to the advertisement receiver for a predetermined time, and when the predetermined time is over, the display unit 210 is configured to provide the additional service to the advertisement receiver. You can control it.
  • the sensor unit 240 senses objects such as obstacles around the unmanned vehicle 200 and provides the sensed information to the processor 235, so that the processor 235 allows the unmanned vehicle 200 to avoid surrounding obstacles. It is possible to generate a driving signal to move while moving.
  • the sensor unit 240 may include an ultrasonic sensor, a RAdio Detection And Ranging (RADAR) sensor, and a Light Detection And Ranging (LiDAR) sensor.
  • RADAR RAdio Detection And Ranging
  • LiDAR Light Detection And Ranging
  • the ultrasonic sensor may be a sensor configured to detect surrounding objects of the unmanned mobile body 200 using ultrasonic signals. Also, the ultrasonic sensor may be configured to detect positions, directions, and distances of objects around the unmanned mobile body 200 .
  • the RADAR sensor may be a sensor configured to detect objects around the unmanned vehicle 200 using radio signals.
  • the RADAR sensor may be configured to detect the direction, speed, and distance of objects around the unmanned vehicle 200.
  • the LiDAR sensor may be a sensor configured to detect surrounding objects of the unmanned vehicle 200 using a laser.
  • the LiDAR sensor may be configured to detect the position, direction, speed, and distance of objects around the unmanned vehicle 200 .
  • FIG. 3 is a block diagram of a server 300 according to an embodiment of the present invention.
  • the route setting unit 305 checks the existence of a group of advertisement recipients near the location information of the unmanned mobile vehicle, sets the location of the group of advertisement recipients as the destination, and calculates a route from the location information of the unmanned vehicle to the destination. It calculates and transmits the calculated path to the unmanned mobile body 100 or 200 through the communication unit. If the number of advertisement acceptor groups is plural, the route setting unit 305 may set another advertisement acceptor group other than the advertisement acceptor group set as the destination as a stopover of the route.
  • the image acquisition unit 310 acquires the image data from cameras located within a predetermined radius based on location information of the unmanned mobile body or the unmanned mobile body on the map data.
  • the learning data generation unit 315 generates learning data for classifying the advertisement recipients using image data obtained from the unmanned mobile vehicles 100 and 200 .
  • the advertisement recipient classification model generation unit 320 generates the advertisement recipient classification model using the generated learning data, and provides the advertisement recipient classification model to the unmanned mobile vehicle through a network.
  • the image analyzer 325 identifies the advertisement recipients in the image data through image analysis of the acquired image data, and if the number of the identified advertisement recipients is greater than or equal to a preset number, the advertisement recipients are classified as the advertisement recipient group. Decide.
  • the advertisement providing unit 330 stores advertisements that advertisers want to provide to advertisement receivers, and may change advertisements to be provided to advertisement receivers by reflecting feedback from advertisement receivers.
  • FIG. 4 is a flowchart illustrating a method of providing advertisements in an unmanned mobile vehicle 200 according to an embodiment of the present invention.
  • the unmanned mobile vehicles 100 and 200 measure their current location (S105), and then receive map data to confirm their location on the map data (S110). Then, the unmanned mobile bodies 100 and 200 acquire image data (S115), and when a path is set (S120), they move according to the set path (S125). At this time, the path may be determined by the server 150. For example, when the server 150 confirms the existence of a group of advertisement recipients near the location information of the unmanned mobile bodies 100 and 200, it sets the location of the group of advertisement recipients as a destination, and After calculating the route from the location information to the destination (the location of the advertisement receiver group), it can be transmitted to the unmanned mobile bodies 100 and 200. Of course, the unmanned mobile bodies 100 and 200 may move along a pre-stored path.
  • the unmanned mobile bodies 100 and 200 search for an avoidance path (S135), If it is determined that there is no obstacle in (S130 'No'), it is determined whether there are advertisement receivers around the route (S140). If there are advertisement recipients around the path (Yes in S140), the unmanned mobile bodies 100 and 200 move in the direction of the advertisement recipient (S145), identify the advertisement recipient, and provide advertisements for each identified advertisement recipient (S145). S150).
  • the unmanned moving object 100, 200 determines that the advertisement recipient is moving through image processing (Yes in S155), it moves in consideration of the advertisement recipient's moving speed and movement direction (S160), and when feedback is received from the advertisement recipient (S165), a service corresponding to the received feedback is provided (S170).
  • FIG. 5 is a flowchart of a method for providing advertisements between the unmanned mobile vehicles 100 and 200 and the server 150 according to another embodiment of the present invention.
  • the unmanned mobile bodies 100 and 200 determine the current location (S205) and obtain map data (S207).
  • the server 150 acquires the surrounding image data of the unmanned mobile bodies 100 and 200 (S210)
  • the server 150 determines a location within a predetermined radius based on the location information of the unmanned mobile bodies 100 and 200 on the map data.
  • Image data is obtained from cameras, and advertisement recipients are identified in the image data through image analysis of the obtained image data.
  • the advertisement recipients may be set as an advertisement recipient group.
  • the server 150 may set a priority based on the number of advertisement acceptor groups included in the advertisement acceptor group (S220).
  • the server 150 may set the movement path of the unmanned mobile vehicles 100 and 200 to provide advertisements in the order determined in step S220 (S230).
  • advertisement acceptor groups other than the advertisement acceptor group set as the destination may be set as waypoints of a route to the destination.
  • the unmanned mobile bodies 100 and 200 While moving along the path (S235), the unmanned mobile bodies 100 and 200 find a group of advertisement recipients (S240), and identify the advertisement recipients (S245). Then, the unmanned mobile bodies 100 and 200 provide advertisements for each identified advertisement recipient (S250) and transmit the obtained image data to the server 150 (S252). The server 150 updates learning data for identifying advertisement recipients using the transmitted image data to generate an advertisement recipient identification learning model (S255), and transmits the generated learning model to the unmanned mobile bodies 100 and 200. (S257).
  • the unmanned mobile bodies 100 and 200 update the advertisement receiver identification learning model (S260).
  • step S150 of FIG. 4 is a method flowchart for explaining step S150 of FIG. 4 in detail.
  • the unmanned mobile bodies 100 and 200 acquire images of advertisement recipients (S305), perform image analysis based on machine learning (S310), and identify advertisement recipients (S315). Then, the unmanned mobile bodies 100 and 200 select advertisements for each identified advertisement recipient. For example, in an embodiment of the present invention, an advertisement recipient may be identified as male, female, adult, or child, and an appropriate advertisement may be selected and provided according to the identified advertisement recipient.
  • FIG. 7 is a method flowchart for explaining step S165 of FIG. 4 in detail.
  • the unmanned mobile body 100 or 200 analyzes the gaze of the advertisement recipient (S410) and measures the advertisement recipient's interest in the advertisement (S415). For example, when the advertisement recipient's gaze is directed toward a display unit providing advertisements for a certain period of time or longer, or the advertisement recipient is moving in the moving direction of the unmanned moving object (100, 200), according to an embodiment of the present invention, the advertisement recipient's interest can be judged to be high.
  • the unmanned mobile bodies 100 and 200 continue to provide the existing advertisement (S430), and if not (No in S420), change the advertisement (S425).
  • the unmanned mobile bodies 100 and 200 provide advertisements to advertisement recipients for a predetermined period of time (S435), and when additional services are requested from advertisement recipients (S440), additional services are provided (S445).
  • An additional service may be video content viewing, internet service, purchase information for the advertisement, and the like.
  • FIG. 8 is a flowchart of an advertisement providing method of unmanned mobile bodies 100 and 200 according to another embodiment of the present invention.
  • the unmanned mobile bodies 100 and 200 may determine the density of the advertisement receivers (S510) and move in order of higher density. And, after the unmanned mobile bodies 100 and 200 classify advertisement recipients (S520), they provide advertisement services according to the classification result (S525).
  • FIG. 9 is a flowchart of a method for providing advertisements in the server 150 according to an embodiment of the present invention.
  • the server 150 stores advertisements to be provided to advertisement recipients (S600), receives an input of advertisement recipients to provide advertisements from the advertiser (S605), and delivers the advertisement recipient target information to the unmanned mobile bodies 100 and 200. (S610). Then, the server 150 obtains feedback information from advertisement recipients (S615) and provides the obtained feedback information to the advertiser (S620).
  • FIG. 10 is a flowchart of a method of providing advertisements for unmanned mobile vehicles 100 and 200 according to another embodiment of the present invention.
  • the unmanned mobile bodies 100 and 200 measure the current location (S700), receive map data (S705), and receive a route (S710). In addition, the unmanned mobile bodies 100 and 200 receive advertisement recipient target information (S715), acquire surrounding images while moving along the route (S720), and determine whether an advertisement recipient is detected (S725). Then, when an advertisement recipient is detected (S725, Yes), the unmanned mobile bodies 100 and 200 move to the detected location (S730) and provide advertisements (S735). In addition, when the advertisement receiver feedback is obtained (S740), the unmanned mobile bodies 100 and 200 transmit the obtained feedback to the server 150 (S745) and determine whether provision of the advertisement has ended (S750).
  • the unmanned mobile bodies 100 and 200 stop the advertisement and return to the original path position when the provision of the advertisement is terminated (Yes in S750) (S755).
  • the present invention can be used in the field of managing advertisements when performing advertisements using a mobile robot device, for example, measuring the effectiveness of advertisements or providing advertisements.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Development Economics (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • Robotics (AREA)
  • Mechanical Engineering (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Entrepreneurship & Innovation (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Game Theory and Decision Science (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)

Abstract

The present invention relates to a method and a system for providing an advertisement on an unmanned vehicle, the method comprising the steps of: acquiring location information about an unmanned vehicle; acquiring map data corresponding to the acquired location information; acquiring image data on the surroundings of the unmanned vehicle; acquiring a route up to a destination from the acquired location information; moving on the basis of the acquired path; identifying an advertisement recipient from the acquired image data when the advertisement recipient is present while moving on the route; and displaying the advertisement for each identified advertisement recipient.

Description

무인 이동체에서의 광고 제공 방법 및 시스템Advertisement providing method and system in unmanned mobile vehicle
본 발명은 무인 이동체에서의 서비스 제공 방법 및 시스템에 관한 것으로, 특히 무인 이동체를 통해 광고 수용자에게 광고를 제공하기 위한 방법 및 시스템에 관한 것이다.The present invention relates to a service providing method and system in an unmanned mobile vehicle, and more particularly, to a method and system for providing advertisements to advertisement recipients through an unmanned mobile vehicle.
근래 컴퓨팅 기술과 머신 러닝 알고리즘의 발달로 인하여 구글(Google) 이나 테슬라(Tesla)와 같은 글로벌 기업들을 선두로 차량에서의 자율 주행 기술 개발이 활발하게 이루어지고 있으며, 그와 더불어 높은 인건비와 작업의 위험도를 고려하여 점차 사람이 직접 운용하지 않는 무인 이동체들에 대한 연구도 활발하게 이루어지고 있다. Recently, due to the development of computing technology and machine learning algorithms, global companies such as Google and Tesla are actively developing self-driving technology in vehicles, along with high labor costs and risks of work. In consideration of this, research on unmanned vehicles that are not directly operated by humans is being actively conducted.
무인 이동체란, 외부 환경을 인식해 스스로 상황을 판단하여 이동하고, 필요시에는 작업을 수행할 수 있는 이동체를 의미한다. 이러한 무인 이동체는 외부 환경이나 자체 운동량 등을 탐지하고 인식할 수 있는 능력, 스스로 및 타 물체를 움직일 수 있는 능력, 주어진 계획에 따라 이동체를 조종하고 임무를 수행하며, 이를 위하여 운용자와 상호 작용할 수 있는 수단이 구비되어 원격에서 운용자가 무인 이동체를 제어할 수도 있다. An unmanned mobile body refers to a mobile body capable of recognizing an external environment, determining a situation by itself, moving, and performing work when necessary. These unmanned mobile vehicles have the ability to detect and recognize the external environment or their own momentum, the ability to move themselves and other objects, and the ability to maneuver and perform missions according to a given plan, and to interact with operators for this purpose. A means is provided so that the operator can remotely control the unmanned mobile vehicle.
따라서, 무인 이동체는 유동 인구가 많은 곳에서 사람을 대신하여 다양한 안내 서비스, 도움 제공, 보안, 치안 유지 업무 등을 담당할 수 있어, 무인 이동체를 광고 컨텐츠를 제공하기 위한 플랫폼으로서 활용하기 위한 방안들도 산업계에서 고려되고 있는 것이 현실이다. Therefore, the unmanned mobile vehicle can be in charge of various guidance services, assistance, security, and public order maintenance tasks on behalf of people in places with a large floating population. It is also a reality that is being considered in the industry.
본 발명은 상술한 필요성에 따라 안출 된 것으로, 본 발명의 목적은 딥러닝 기반 객체 인식 알고리즘을 활용하여 무인 이동체가 이동하는 중에 식별된 광고 수용자별 맞춤 광고 컨텐츠를 제공하는 데 그 목적이 있다.The present invention has been devised in accordance with the above-mentioned needs, and an object of the present invention is to provide customized advertisement contents for each advertisement recipient identified while an unmanned mobile vehicle is moving by utilizing a deep learning-based object recognition algorithm.
상술한 목적을 달성하기 위한 본 발명의 일 실시 예에 따른 무인 이동체에서의 광고 제공 방법은, 상기 무인 이동체의 위치 정보를 획득하는 단계; 상기 획득된 위치 정보에 해당하는 지도 데이터를 획득하는 단계; 상기 무인 이동체 주변의 영상 데이터를 획득하는 단계; 상기 획득된 위치 정보로부터 목적지까지의 경로를 획득하는 단계; 상기 획득된 경로에 기반하여 이동하는 단계; 상기 경로를 이동하는 중에 광고 수용자가 존재한다면, 상기 획득된 영상데이터로부터 상기 광고 수용자를 식별하는 단계; 및 상기 식별된 광고 수용자 별로 광고를 표시하는 단계를 포함한다. To achieve the above object, a method for providing an advertisement in an unmanned mobile vehicle according to an embodiment of the present invention includes acquiring location information of the unmanned mobile vehicle; acquiring map data corresponding to the acquired location information; obtaining image data around the unmanned vehicle; obtaining a route to a destination from the obtained location information; moving based on the acquired path; identifying the advertisement recipient from the obtained image data, if there is an advertisement recipient while moving along the path; and displaying an advertisement for each of the identified advertisement recipients.
그리고, 상기 획득된 위치 정보로부터 목적지까지의 경로를 획득하는 단계는, 상기 무인 이동체의 위치 정보 근처의 광고 수용자 집단의 존재를 확인하는 단계; 상기 광고 수용자 집단의 위치를 상기 목적지로 설정하는 단계; 및 상기 무인 이동체의 위치 정보로부터 상기 목적지까지의 경로를 계산하는 단계;를 포함한다. The obtaining of a route from the obtained location information to the destination may include: confirming existence of a group of advertisement recipients near the location information of the unmanned mobile vehicle; setting the location of the advertisement recipient group as the destination; and calculating a route to the destination from the location information of the unmanned mobile vehicle.
또한, 상기 광고 수용자 집단의 존재를 확인하는 단계는, 상기 지도 데이터 상에서 상기 무인 이동체의 위치 정보를 기준으로 소정 반경 이내에 위치한 카메라들로부터 영상 데이터를 획득하는 단계; 상기 획득된 영상 데이터의 영상 분석을 통해 상기 영상 데이터 내에 상기 광고 수용자들을 식별하는 단계; 및 상기 식별된 광고 수용자의 수가 미리 설정된 수 이상이라면, 상기 광고 수용자들을 상기 광고 수용자 집단으로 결정하는 단계;를 포함한다. In addition, the step of confirming the existence of the advertisement acceptor group may include obtaining image data from cameras located within a predetermined radius based on location information of the unmanned mobile object on the map data; identifying the advertisement recipients within the image data through image analysis of the obtained image data; and if the number of the identified advertisement recipients is equal to or greater than a preset number, determining the advertisement recipients as the advertisement recipient group.
그리고, 상기 무인 이동체의 위치 정보로부터 상기 목적지까지의 경로를 계산하는 단계는, 상기 광고 수용자 집단이 복수 개라면, 상기 목적지로 설정된 광고 수용자 집단 외의 다른 광고 수용자 집단은 상기 경로의 경유지로 설정하는 단계; 를 더 포함한다. In addition, in the step of calculating a route from the location information of the unmanned mobile vehicle to the destination, if there are a plurality of advertisement acceptor groups, setting an advertisement acceptor group other than the advertisement acceptor group set as the destination as a stopover of the route. ; more includes
또한, 상기 광고 수용자는, 광고주에 의해 광고를 수용할 대상들로 결정되며, 상기 획득된 영상 데이터를 머신 러닝 기반의 학습 모델을 이용하여 남성, 여성, 성인, 아동 중 어느 하나의 대상들로 분류됨을 특징으로 한다. In addition, the advertisement recipients are determined by the advertiser as targets to accept advertisements, and the obtained image data is classified into any one of men, women, adults, and children using a machine learning-based learning model characterized by being
그리고, 상기 광고 수용자에 대한 영상 분석 결과, 상기 광고 수용자가 이동 중이라면, 상기 광고 수용자의 이동 방향 및 이동 속도에 따라 상기 무인 이동체의 이동을 제어하는 단계를 더 포함한다. The method further includes controlling the movement of the unmanned mobile body according to the movement direction and speed of the advertisement recipient when the advertisement recipient is on the move as a result of the video analysis of the advertisement recipient.
또한, 상기 경로를 이동하는 중에 광고 수용자가 존재한다면, 상기 광고 수용자가 있는 위치로, 상기 무인 이동체를 이동 시키는 단계를 더 포함한다. The method further includes moving the unmanned mobile body to a location where the advertisement acceptor is located, if there is an advertisement acceptor while moving along the path.
그리고, 상기 분류된 광고 수용자 별로, 상기 광고주가 제공하도록 설정한 광고 컨텐츠를 제공하는 단계를 더 포함한다. The method further includes providing advertisement contents set to be provided by the advertiser for each of the classified advertisement recipients.
또한, 상기 광고 수용자로부터 상기 광고 컨텐츠에 대한 피드백을 수신하는 단계; 및 상기 수신된 피드백에 따라 상기 광고 수용자에게 미리 정해진 부가 서비스를 제공하는 단계를 더 포함하고, 상기 부가 서비스는, 동영상 컨텐츠 시청, 인터넷 서비스, 상기 광고 컨텐츠에 대한 구매 정보 중 적어도 하나를 포함한다. In addition, receiving feedback on the advertisement content from the advertisement receiver; and providing a predetermined additional service to the advertisement recipient according to the received feedback, wherein the additional service includes at least one of video content viewing, internet service, and purchase information for the advertisement content.
그리고, 상기 광고 수용자로부터 상기 광고 컨텐츠에 대한 피드백을 수신하는 단계는, 상기 광고 수용자에 대해 획득된 이미지 분석을 통해, 상기 광고 수용자의 시선 방향을 획득하는 단계; 상기 광고 수용자 시선의 방향을 분석하는 단계; 및 상기 광고 수용자의 시선이 상기 무인 이동체에서 제공하는 광고를 시청하고 있다면, 상기 광고 수용자에게 상기 광고를 미리 정해진 시간 동안 계속 제공하고, 상기 미리 정해진 시간이 종료되면, 상기 부가 서비스를 상기 광고 수용자에게 제공하는 단계;를 포함한다. The receiving of feedback on the advertisement content from the advertisement receiver may include: obtaining a gaze direction of the advertisement receiver through image analysis obtained with respect to the advertisement receiver; analyzing the direction of the gaze of the advertisement recipient; and if the gaze of the advertisement receiver is watching the advertisement provided by the unmanned mobile vehicle, the advertisement is continuously provided to the advertisement receiver for a predetermined time, and when the predetermined time expires, the additional service is provided to the advertisement receiver. It includes; providing;
상술한 목적을 달성하기 위한 본 발명의 일 실시 예에 따른 무인 이동체에서의 광고 제공 시스템은, 외부 서버와 통신하는 통신부; 표시부; 상기 무인 이동체 외부의 영상 데이터를 획득하는 카메라; 상기 무인 이동체의 위치 정보를 획득하는 위치 정보 획득부; 학습 기반의 광고 수용자 분류 모델과 상기 획득된 위치 정보에 해당하는 지도 데이터를 저장하는 메모리; 구동 신호에 의해 상기 무인 이동체의 이동 방향 및 이동 속도를 제어하는 구동부; 및 상기 획득된 위치 정보로부터 목적지까지의 경로를 획득하고, 상기 무인 이동체를 상기 획득된 경로에 기반하여 이동하도록 상기 구동 신호를 발생시키고, 상기 경로를 이동하는 중에 광고 수용자가 존재한다면, 상기 광고 수용자 분류 모델을 이용하여 상기 획득된 영상 데이터로부터 상기 광고 수용자를 식별하고, 상기 식별된 광고 수용자 별로 광고를 표시하도록 상기 표시부를 제어하는 프로세서;를 포함한다. An advertisement providing system in an unmanned mobile vehicle according to an embodiment of the present invention for achieving the above object includes a communication unit communicating with an external server; display unit; a camera acquiring image data of the outside of the unmanned vehicle; a location information acquisition unit acquiring location information of the unmanned mobile vehicle; a memory for storing a learning-based advertisement recipient classification model and map data corresponding to the obtained location information; a driving unit controlling a moving direction and a moving speed of the unmanned mobile body by a driving signal; and obtaining a route from the obtained location information to a destination, generating the driving signal to move the unmanned vehicle based on the obtained route, and if there is an advertisement acceptor while moving on the route, the advertisement acceptor and a processor configured to identify the advertisement recipients from the acquired image data using a classification model and control the display unit to display advertisements for each of the identified advertisement recipients.
그리고, 상기 외부 서버는, 상기 무인 이동체의 위치 정보 근처의 광고 수용자 집단의 존재를 확인하고, 상기 광고 수용자 집단의 위치를 상기 목적지로 설정하고, 상기 무인 이동체의 위치 정보로부터 상기 목적지까지의 경로를 계산하고, 상기 계산된 경로를 상기 통신부를 통해 상기 무인 이동체로 송신하는 경로 설정부; 상기 무인 이동체 또는 상기 지도 데이터 상에서 상기 무인 이동체의 위치 정보를 기준으로 소정 반경 이내에 위치한 카메라들로부터 상기 영상 데이터를 획득하는 영상 획득부; 상기 무인 이동체로부터 획득된 영상 데이터를 이용하여 상기 광고 수용자를 분류하기 위한 학습용 데이터를 생성하는 학습 데이터 생성부; 상기 생성된 학습 데이터를 이용하여 상기 광고 수용자 분류 모델을 생성하고, 네트워크를 통해 상기 무인 이동체로 상기 광고 수용자 분류 모델을 제공하는 광고 수용자 분류 모델 생성부; 및 상기 획득된 영상 데이터의 영상 분석을 통해 상기 영상 데이터 내에 상기 광고 수용자들을 식별하고, 상기 식별된 광고 수용자의 수가 미리 설정된 수 이상이라면, 상기 광고 수용자들을 상기 광고 수용자 집단으로 결정하는 영상 분석부;를 포함한다. In addition, the external server checks the presence of a group of advertisement recipients near the location information of the unmanned mobile body, sets the location of the group of advertisement recipients as the destination, and calculates a route from the location information of the unmanned mobile body to the destination. a path setting unit that calculates and transmits the calculated path to the unmanned mobile vehicle through the communication unit; an image acquiring unit acquiring the image data from cameras located within a predetermined radius based on location information of the unmanned mobile body or the unmanned mobile body on the map data; a learning data generation unit generating learning data for classifying the advertisement recipients using image data acquired from the unmanned mobile vehicle; an advertisement receiver classification model generation unit generating the advertisement receiver classification model using the generated learning data and providing the advertisement receiver classification model to the unmanned mobile vehicle through a network; and an image analyzer configured to identify the advertisement recipients in the image data through video analysis of the acquired image data, and to determine the advertisement recipients as the advertisement recipient group if the number of the identified advertisement recipients is greater than or equal to a preset number; includes
또한, 상기 경로 설정부는, 상기 광고 수용자 집단이 복수 개라면, 상기 목적지로 설정된 광고 수용자 집단 외의 다른 광고 수용자 집단은 상기 경로의 경유지로 설정하는 것을 특징으로 한다. Further, the route setting unit may set an advertisement acceptor group other than the advertisement acceptor group set as the destination as a stopover of the route if the advertisement acceptor group is plural.
그리고, 상기 광고 수용자는, 광고주에 의해 광고를 수용할 대상들로 결정되며, 상기 획득된 영상 데이터를 머신 러닝 기반의 학습 모델을 이용하여 남성, 여성, 성인, 아동 중 어느 하나의 대상들로 분류됨을 특징으로 한다. And, the advertisement recipients are determined by the advertiser as targets to accept advertisements, and the obtained image data is classified into any one of men, women, adults, and children by using a machine learning-based learning model. characterized by being
또한, 상기 프로세서는, 상기 광고 수용자에 대한 영상 분석 결과, 상기 광고 수용자가 이동 중이라면, 상기 광고 수용자의 이동 방향 및 이동 속도에 따라 상기 무인 이동체의 이동을 제어하기 위해 상기 구동 신호를 발생시킴을 특징으로 한다. In addition, the processor generates the driving signal to control the movement of the unmanned mobile body according to the movement direction and speed of the advertisement recipient when the advertisement recipient is moving as a result of the video analysis of the advertisement recipient. to be characterized
그리고, 상기 프로세서는, 상기 경로를 이동하는 중에 상기 광고 수용자가 존재한다면, 상기 광고 수용자가 있는 위치로, 상기 무인 이동체를 이동 시키기 위한 상기 구동 신호를 발생시킴을 특징으로 한다. And, the processor may generate the driving signal for moving the unmanned mobile body to a location where the advertisement acceptor is located, if the advertisement acceptor is present while moving on the path.
또한, 상기 프로세서는, 상기 분류된 광고 수용자 별로, 상기 광고주가 제공하도록 설정한 광고 컨텐츠를 제공하도록 상기 표시부를 제어함을 특징으로 한다. In addition, the processor may control the display unit to provide advertisement contents set to be provided by the advertiser for each of the classified advertisement recipients.
그리고, 상기 프로세서는, 상기 광고 수용자로부터 상기 광고 컨텐츠에 대한 피드백을 수신하고, 상기 수신된 피드백에 따라 상기 광고 수용자에게 미리 정해진 부가 서비스를 제공함을 특징으로 하고, 상기 부가 서비스는, 동영상 컨텐츠 시청, 인터넷 서비스, 상기 광고 컨텐츠에 대한 구매 정보 중 적어도 하나를 포함한다. And, the processor is characterized in that it receives feedback on the advertising content from the advertisement recipient, and provides a predetermined additional service to the advertisement recipient according to the received feedback, wherein the additional service includes video content viewing, It includes at least one of an Internet service and purchase information for the advertising content.
또한, 상기 프로세서는, 상기 광고 수용자에 대해 획득된 이미지 분석을 통해, 상기 광고 수용자의 시선 방향을 획득하고, 상기 광고 수용자 시선의 방향을 분석하고, 상기 광고 수용자의 시선이 상기 무인 이동체에서 제공하는 광고를 시청하고 있다면, 상기 광고 수용자에게 상기 광고를 미리 정해진 시간 동안 계속 제공하고, 상기 미리 정해진 시간이 종료되면, 상기 부가 서비스를 상기 광고 수용자에게 제공함을 특징으로 한다. In addition, the processor obtains a gaze direction of the advertisement recipient through image analysis obtained with respect to the advertisement recipient, analyzes the direction of the gaze of the advertisement recipient, and determines whether the gaze of the advertisement recipient is provided by the unmanned mobile body. If the user is watching the advertisement, the advertisement is continuously provided to the advertisement receiver for a predetermined time period, and when the predetermined time period ends, the supplementary service is provided to the advertisement receiver.
이상에서 설명한 바와 같이 본 명세서에 따르면, 무인 이동체의 이동 중에 딥 러닝 기반의 객체 인식 알고리즘을 통해 식별된 광고 수용자별로 맞춤형 광고 컨텐츠를 제공할 수 있어, 광고주가 원하는 광고 효과를 용이하게 달 성 할 수 있다.As described above, according to the present specification, customized advertisement contents can be provided for each advertisement recipient identified through a deep learning-based object recognition algorithm while the unmanned vehicle is moving, so that advertisers can easily achieve the desired advertising effect. there is.
도 1은 본 발명의 실시예에 따른 무인 이동체에서의 광고 제공 시스템을 도시한 도면,1 is a diagram showing an advertisement providing system in an unmanned mobile vehicle according to an embodiment of the present invention;
도 2는 본 발명의 실시 예에 따른 무인 이동체의 블록 구성도, 2 is a block diagram of an unmanned mobile vehicle according to an embodiment of the present invention;
도 3은 본 발명의 실시 예에 따른 서버의 블록 구성도, 3 is a block diagram of a server according to an embodiment of the present invention;
도 4는 본 발명의 실시 예에 따라 무인 이동체에서의 광고 제공 방법을 나타낸 흐름도, 4 is a flowchart illustrating a method of providing advertisements in an unmanned mobile vehicle according to an embodiment of the present invention;
도 5는 본 발명의 다른 실시 예에 따른 무인 이동체와 서버간의 광고 제공 방법의 흐름도, 5 is a flowchart of an advertisement providing method between an unmanned mobile vehicle and a server according to another embodiment of the present invention;
도 6은 도 4의 S150단계를 상세히 설명하기 위한 방법 흐름도, 6 is a method flowchart for explaining step S150 of FIG. 4 in detail;
도 7은 도 4의 S165단계를 상세히 설명하기 위한 방법 흐름도, 7 is a method flowchart for explaining step S165 of FIG. 4 in detail;
도 8은 본 발명의 다른 실시 예에 따른 무인 이동체의 광고 제공 방법 흐름도, 8 is a flowchart of a method for providing an advertisement for an unmanned mobile vehicle according to another embodiment of the present invention;
도 9는 본 발명의 실시 예에 따른 서버에서의 광고 제공 방법 흐름도, 및9 is a flowchart of a method for providing advertisements in a server according to an embodiment of the present invention, and
도 10은 본 발명의 다른 실시 예에 따른 무인 이동체의 광고 제공 방법 흐름도이다.10 is a flowchart of a method for providing an advertisement for an unmanned mobile vehicle according to another embodiment of the present invention.
이하의 내용은 단지 본 발명의 원리를 예시한다. 그러므로 당업자는 비록 본 명세서에 명확히 설명되거나 도시 되지 않았지만 본 발명의 원리를 구현하고 본 발명의 개념과 범위에 포함된 다양한 장치를 발명할 수 있는 것이다. 또한, 본 명세서에 열거된 모든 조건부 용어 및 실시 예들은 원칙적으로, 본 발명의 개념이 이해되도록 하기 위한 목적으로만 명백히 의도되고, 이와 같이 특별히 열거된 실시 예들 및 상태들에 제한적이지 않는 것으로 이해되어야 한다.The following merely illustrates the principles of the present invention. Therefore, those skilled in the art can invent various devices that embody the principles of the present invention and fall within the concept and scope of the present invention, even though not explicitly described or shown herein. In addition, all conditional terms and embodiments listed in this specification are, in principle, expressly intended only for the purpose of understanding the concept of the present invention, and should be understood not to be limited to such specifically listed embodiments and conditions. do.
또한, 본 발명의 원리, 관점 및 실시 예들 뿐만 아니라 특정 실시 예를 열거하는 모든 상세한 설명은 이러한 사항의 구조적 및 기능적 균등물을 포함하도록 의도되는 것으로 이해되어야 한다. 또한 이러한 균등물들은 현재 공지된 균등물뿐만 아니라 장래에 개발될 균등물 즉 구조와 무관하게 동일한 기능을 수행하도록 발명된 모든 소자를 포함하는 것으로 이해되어야 한다.In addition, it should be understood that all detailed descriptions reciting specific embodiments, as well as principles, aspects and embodiments of the present invention, are intended to encompass structural and functional equivalents of these matters. In addition, it should be understood that such equivalents include not only currently known equivalents but also equivalents developed in the future, that is, all devices invented to perform the same function regardless of structure.
따라서, 예를 들어, 본 명세서의 블럭도는 본 발명의 원리를 구체화하는 예시적인 회로의 개념적인 관점을 나타내는 것으로 이해되어야 한다. 이와 유사하게, 모든 흐름도, 상태 변환도, 의사 코드 등은 컴퓨터가 판독 가능한 매체에 실질적으로 나타낼 수 있고 컴퓨터 또는 프로세서가 명백히 도시되었는지 여부를 불문하고 컴퓨터 또는 프로세서에 의해 수행되는 다양한 프로세스를 나타내는 것으로 이해되어야 한다.Thus, for example, the block diagrams herein are to be understood as representing conceptual views of exemplary circuits embodying the principles of the present invention. Similarly, all flowcharts, state transition diagrams, pseudo code, etc., are meant to be tangibly represented on computer readable media and represent various processes performed by a computer or processor, whether or not the computer or processor is explicitly depicted. It should be.
프로세서 또는 이와 유사한 개념으로 표시된 기능 블럭을 포함하는 도면에 도시된 다양한 소자의 기능은 전용 하드웨어뿐만 아니라 적절한 소프트웨어와 관련하여 소프트웨어를 실행할 능력을 가진 하드웨어의 사용으로 제공될 수 있다. 프로세서에 의해 제공될 때, 상기 기능은 단일 전용 ㅋ프로세서, 단일 공유 프로세서 또는 복수의 개별적 프로세서에 의해 제공될 수 있고, 이들 중 일부는 공유될 수 있다.The functions of various elements shown in the drawings including functional blocks represented by processors or similar concepts may be provided using dedicated hardware as well as hardware capable of executing software in conjunction with appropriate software. When provided by a processor, the functionality may be provided by a single dedicated processor, a single shared processor, or a plurality of separate processors, some of which may be shared.
또한 프로세서, 제어 또는 이와 유사한 개념으로 제시되는 용어의 명확한 사용은 소프트웨어를 실행할 능력을 가진 하드웨어를 배타적으로 인용하여 해석되어서는 아니되고, 제한 없이 디지털 신호 프로세서(DSP) 하드웨어, 소프트웨어를 저장하기 위한 롬(ROM), 램(RAM) 및 비 휘발성 메모리를 암시적으로 포함하는 것으로 이해되어야 한다. 주지관용의 다른 하드웨어도 포함될 수 있다.In addition, the explicit use of terms presented as processor, control, or similar concepts should not be construed as exclusively citing hardware capable of executing software, but without limitation, digital signal processor (DSP) hardware, ROM for storing software (ROM), random access memory (RAM) and non-volatile memory. Other hardware for the governor's use may also be included.
본 명세서의 청구범위에서, 상세한 설명에 기재된 기능을 수행하기 위한 수단으로 표현된 구성요소는 예를 들어 상기 기능을 수행하는 회로 소자의 조합 또는 펌웨어/마이크로 코드 등을 포함하는 모든 형식의 소프트웨어를 포함하는 기능을 수행하는 모든 방법을 포함하는 것으로 의도되었으며, 상기 기능을 수행하도록 상기 소프트웨어를 실행하기 위한 적절한 회로와 결합된다. 이러한 청구범위에 의해 정의되는 본 발명은 다양하게 열거된 수단에 의해 제공되는 기능들이 결합되고 청구항이 요구하는 방식과 결합되기 때문에 상기 기능을 제공할 수 있는 어떠한 수단도 본 명세서로부터 파악되는 것과 균등한 것으로 이해되어야 한다.In the claims of this specification, components expressed as means for performing the functions described in the detailed description include, for example, a combination of circuit elements performing the functions or all types of software including firmware/microcode, etc. It is intended to include any method that performs the function of performing the function, combined with suitable circuitry for executing the software to perform the function. Since the invention defined by these claims combines the functions provided by the various enumerated means and is combined in the manner required by the claims, any means capable of providing such functions is equivalent to that discerned from this specification. should be understood as
또한, 본 명세서에서 사용되는 단수의 표현은 문맥상 명백하게 다르게 뜻하지 않는 한, 복수의 표현을 포함한다. 본 출원에서, "구성된다" 또는 "포함한다" 등의 용어는 명세서 상에 기재된 여러 구성 요소들, 또는 여러 단계들을 반드시 모두 포함하는 것으로 해석되지 않아야 하며, 그 중 일부 구성 요소들 또는 일부 단계들은 포함되지 않을 수도 있고, 또는 추가적인 구성 요소 또는 단계들을 더 포함할 수 있는 것으로 해석되어야 한다.Also, singular expressions used in this specification include plural expressions unless the context clearly indicates otherwise. In this application, terms such as "consisting of" or "comprising" should not be construed as necessarily including all of the various components or steps described in the specification, and some of the components or some of the steps It should be construed that it may not be included, or may further include additional components or steps.
또한, 본 명세서에서 사용되는 구성요소에 대한 접미사 "모듈" 및 "부"는 명세서 작성의 용이함만이 고려되어 부여되거나 혼용되는 것으로서, 그 자체로 서로 구별되는 의미 또는 역할을 갖는 것은 아니다.In addition, the suffixes "module" and "unit" for the components used in this specification are given or used together in consideration of ease of writing the specification, and do not have meanings or roles that are distinguished from each other by themselves.
또한, 본 명세서에서 사용되는 제1, 제2 등과 같이 서수를 포함하는 용어는 다양한 구성 요소들을 설명하는 데 사용될 수 있지만, 상기 구성 요소들은 상기 용어들에 의해 한정되어서는 안 된다. 상기 용어들은 하나의 구성요소를 다른 구성요소로부터 구별하는 목적으로만 사용된다. 예를 들어, 본 발명의 권리 범위를 벗어나지 않으면서 제1 구성요소는 제2 구성 요소로 명명될 수 있고, 유사하게 제2 구성 요소도 제1 구성 요소로 명명될 수 있다.Also, terms including ordinal numbers such as first and second used in this specification may be used to describe various components, but the components should not be limited by the terms. These terms are only used for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element, without departing from the scope of the present invention.
도 1은 본 발명의 실시예에 따른 무인 이동체에서의 광고 제공 시스템을 도시한 도면이다. 1 is a diagram illustrating an advertisement providing system in an unmanned mobile vehicle according to an embodiment of the present invention.
도 1을 참고하면, 본 발명의 실시 예에 따른 무인 이동체에서의 광고 제공 시스템은, 무인 이동체(100), AP(Access Point)(105), 제1 네트워크(110), 카메라(115), 제2 네트워크(120) 및 서버(150)를 포함할 수 있다. Referring to FIG. 1 , an advertisement providing system in an unmanned mobile vehicle according to an embodiment of the present invention includes an unmanned mobile vehicle 100, an access point (AP) 105, a first network 110, a camera 115, a first 2 network 120 and server 150.
본 발명의 실시 예에 따른 무인 이동체(100)는 위치 정보를 획득하고, 획득된 위치 정보에 해당하는 지도 데이터가 획득되면, 상기 획득된 지도 데이터 상에서 상기 획득된 위치 정보로부터 목적지까지 정해진 경로를 이동하면서, 주변의 영상 데이터를 획득할 수 있다. The unmanned mobile body 100 according to an embodiment of the present invention acquires location information, and when map data corresponding to the obtained location information is obtained, it travels a route determined from the obtained location information to a destination on the obtained map data. While doing so, it is possible to acquire surrounding image data.
또한, 무인 이동체(100)는 상기 경로를 이동하는 중에 머신 러닝 기반의 학습 모델을 이용하여 상기 획득된 영상 데이터의 분석을 수행하고, 수행된 영상 데이터의 분석 결과, 상기 무인 이동체(100)의 주변에 존재하는지를 판단하고, 주변에 존재하는 광고 수용자를 식별한다. 그리고, 무인 이동체(100)는 상기 식별된 광고 수용자 별로 광고를 제공할 수 있다. In addition, the unmanned mobile body 100 analyzes the obtained image data using a machine learning-based learning model while moving on the path, and as a result of the analysis of the performed image data, the unmanned mobile body 100's surroundings , and identify advertisement recipients existing in the vicinity. In addition, the unmanned mobile body 100 may provide advertisements for each of the identified advertisement recipients.
또한, 무인 이동체(100)는 무선 네트워크를 통해 서버(150)에 연결된 AP(105)에 접속할 수 있으며, 상기 AP(105)는 제1 네트워크(110)를 통해 상기 서버(150)에 연결될 수 있다. 무인 이동체(100)는 Wi-Fi(Wireless Fidelity) 통신, 4G/5G와 같은 셀룰러(Cellular) 기반의 이동 통신, NFC(Near Field Communication) 등의 다양한 무선 접속 규격을 이용하여 AP(105)에 접속할 수 있다. In addition, the unmanned mobile vehicle 100 can access the AP 105 connected to the server 150 through a wireless network, and the AP 105 can be connected to the server 150 through the first network 110. . The unmanned mobile body 100 can access the AP 105 using various wireless access standards such as Wi-Fi (Wireless Fidelity) communication, cellular-based mobile communication such as 4G/5G, and NFC (Near Field Communication). can
무인 이동체(100)는 상기 AP(105)를 통해 서버(150)와 각종 데이터를 송수신할 수 있다. 예컨대, 본 발명의 실시 예에 따른 무인 이동체(100)는 획득된 영상 데이터, 광고 수용자들의 피드백 정보, 경로 주변의 센싱 정보 등을 서버(150)로 전송할 수 있으며, 서버(150)로부터 경로 정보, 목적지 정보, 광고 수용자 분류 및 식별을 위한 학습 모델 알고리즘, 광고 서비스 요청 정보, 광고 데이터 등을 AP(105)를 통해 수신할 수 있다. The unmanned mobile body 100 may transmit and receive various types of data to and from the server 150 through the AP 105 . For example, the unmanned vehicle 100 according to an embodiment of the present invention may transmit acquired image data, feedback information of advertisement recipients, and sensing information around a route to the server 150, and from the server 150, route information, Destination information, a learning model algorithm for classifying and identifying advertisement recipients, advertisement service request information, advertisement data, and the like may be received through the AP 105 .
본 발명의 실시 예에 따른 서버(150)는 AP(105)를 통해 무인 이동체(100)의 위치 정보와 주변 영상 데이터를 획득할 수 있으며, 경로 정보, 목적지 정보, 광고 수용자 분류 기준, 분류된 광고 수용자 별 제공 광고, 경유지 정보 등을 AP(105)를통해 제공할 수 있다. The server 150 according to an embodiment of the present invention may obtain location information and surrounding image data of the unmanned vehicle 100 through the AP 105, route information, destination information, criteria for classifying advertisement recipients, and classified advertisements. Advertisements provided for each recipient, route information, and the like may be provided through the AP 105 .
또한, 본 발명의 실시 예에 따른 서버(150)는 무인 이동체(100)로부터 현재 무인 이동체(100)의 위치 정보가 획득되면, 상기 획득된 무인 이동체(100)의 위치 정보로부터 소정 반경 이내에 위치한 카메라들(115)에서 촬영된 영상 데이터를 획득할 수 있다. 본 발명의 실시 예에 따른 서버(150)는 상기 카메라들(115)로부터 획득된 영상 데이터의 영상 분석을 통해 광고 수용자들을 식별할 수 있고, 상기 식별된 광고 수용자들의 수가 미리 설정된 수 이상이라면, 상기 광고 수용자들을 광고 수용자 집단으로 결정하고, 상기 광고 수용자 집단의 위치를 상기 무인 이동체(100)의 경유지 또는 목적지로 안내할 수도 있다. In addition, when the server 150 according to an embodiment of the present invention obtains location information of the current unmanned mobile vehicle 100 from the unmanned mobile vehicle 100, the camera located within a predetermined radius from the obtained location information of the unmanned mobile vehicle 100. Image data captured in the fields 115 may be obtained. The server 150 according to an embodiment of the present invention may identify advertisement recipients through video analysis of image data obtained from the cameras 115, and if the number of the identified advertisement recipients is greater than or equal to a preset number, the Ad receivers may be determined as an advertisement acceptor group, and the location of the advertisement acceptor group may be guided to a stopover or destination of the unmanned mobile vehicle 100 .
또한, 본 발명의 실시 예에 따른 서버(150)는 식별된 광고 수용자별로 상이한 광고를 제공하도록 무인 이동체(100)를 설정할 수 있다. 예컨대, 식별된 광고 수용자가 남성이라면, 면도기, 스포츠 용품, 남성 향수, 남성 시계 등의 남성 액세서리, 남성용 의류 등에 관련된 광고를 제공하도록 무인 이동체(100)를 제어할 수 있다. 예컨대, 식별된 광고 수용자가 여성이라면, 화장품, 여성 향수, 여성 액세서리, 여성용 의류 등에 관련된 광고를 제공하도록 무인 이동체(100)를 제어할 수 있다. In addition, the server 150 according to an embodiment of the present invention may set the unmanned vehicle 100 to provide different advertisements for each identified advertisement recipient. For example, if the identified advertisement recipient is a man, the unmanned vehicle 100 may be controlled to provide advertisements related to men's accessories such as razors, sports goods, men's perfume, men's watches, men's clothing, and the like. For example, if the identified advertisement recipient is a woman, the unmanned vehicle 100 may be controlled to provide advertisements related to cosmetics, women's perfume, women's accessories, women's clothing, and the like.
상술한 도 1에 따르면, 본 발명의 실시 예에 따른 무인 이동체(100)는 이동을 위한 경로 정보 및 목적지 정보 등을 서버(150)로부터 획득하는 것으로 설명하였으나, 이는 일 실시 예에 불과할 뿐 무인 이동체(100)에 사전에 저장된 경로 및 목적지 정보에 따라 이동할 수도 있다.Referring to FIG. 1 described above, it has been described that the unmanned mobile vehicle 100 according to an embodiment of the present invention acquires route information and destination information for movement from the server 150, but this is only an exemplary embodiment. It is also possible to move according to route and destination information previously stored in (100).
도 2는 본 발명의 실시 예에 따른 무인 이동체(200)의 블록 구성도이다. 2 is a block diagram of an unmanned mobile body 200 according to an embodiment of the present invention.
도 2를 참고하면, 본 발명의 실시 예에 따른 무인 이동체(200)는 통신부(205), 표시부(210), 카메라(215), 위치 정보 획득부(220), 메모리(225), 구동부(230), 프로세서(235) 및 센서부(240)를 포함할 수 있다. Referring to FIG. 2 , an unmanned vehicle 200 according to an embodiment of the present invention includes a communication unit 205, a display unit 210, a camera 215, a location information obtaining unit 220, a memory 225, and a driving unit 230. ), a processor 235 and a sensor unit 240 may be included.
통신부(205)는 정해진 무선 접속 규격에 따라 외부 서버(150)와 통신을 수행하며, 표시부(210)는 광고 수용자들에게 제공할 광고를 표시할 수 있다. 표시부(210)는 상기 무인 이동체(200)의 전후좌우면에 각각 부착될 수 있으며, 광고 수용자들에게 효과적인 광고 전달을 위해 광고 수용자의 시선 또는 눈높이에 따라 높이가 조절될 수 있는 것이 바람직하다. 본 발명의 실시 예에 따른 표시부(210)는 LCD(Liquid Crystal Display), LED(Light Emmiting Diode), OLED(Organic Light Emmiting Diode) 등으로 구성될 수 있으며, 광고 수용자의 터치 입력을 감지할 수 있는 터치 센서가 포함될 수도 있다. The communication unit 205 communicates with the external server 150 according to a predetermined wireless access standard, and the display unit 210 may display advertisements to be provided to advertisement recipients. The display unit 210 may be attached to the front, rear, left, and right sides of the unmanned mobile body 200, respectively, and it is preferable that the height of the display unit 210 be adjusted according to the gaze or eye level of the advertisement receiver in order to effectively deliver the advertisement to advertisement receivers. The display unit 210 according to an embodiment of the present invention may be composed of a Liquid Crystal Display (LCD), Light Emitting Diode (LED), Organic Light Emitting Diode (OLED), or the like, and may sense a touch input of an ad receiver. A touch sensor may also be included.
카메라(215)는 렌즈를 통해 입광된 빛 에너지를 전기 에너지로 변환하는 이미지 센서를 포함하며, 무인 이동체(200) 주변의 외부 객체를 영상 데이터로 변환한다. The camera 215 includes an image sensor that converts light energy received through a lens into electrical energy, and converts external objects around the unmanned mobile body 200 into image data.
위치 정보 획득부(220)는 GPS(Global Positioning System), GLONASS(Global Navigation Satellite)등과 같은 위성 신호를 수신하여 지구상의 위치를 측정하는 수신기를 포함할 수도 있으며, 주변 기지국으로부터 수신한 신호 세기를 측정하여 기지국으로부터의 상대적인 위치를 측정하고, 측정된 위치 정보를 프로세서(235)로 전달할 수 있다. The location information acquisition unit 220 may include a receiver that receives satellite signals such as GPS (Global Positioning System) and GLONASS (Global Navigation Satellite) to measure a location on the earth, and measures signal strength received from neighboring base stations. Thus, the relative location from the base station may be measured, and the measured location information may be transmitted to the processor 235.
메모리(225)는 학습 기반의 광고 수용자 분류 모델, 상기 획득된 위치 정보에 해당하는 지도 데이터, 상기 카메라(215)를 통해 획득된 영상 데이터를 저장할 수 있다. 메모리(225)는 플래시 메모리 타입(flash memory type), 하드디스크 타입(hard disk type), 멀티미디어 카드 마이크로 타입(multimedia card micro type), 카드 타입의 메모리(예를 들어 SD 또는 XD 메모리 등), 램(RAM, Random Access Memory) SRAM(Static Random Access Memory), 롬(ROM, Read-Only Memory), EEPROM(Electrically Erasable Programmable Read-Only Memory), PROM(Programmable Read-Only Memory), 자기 메모리, 자기 디스크, 광디스크 중 적어도 하나의 타입의 저장매체를 포함할 수 있다. The memory 225 may store a learning-based advertisement recipient classification model, map data corresponding to the obtained location information, and image data obtained through the camera 215 . The memory 225 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg SD or XD memory, etc.), RAM (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , an optical disk, and at least one type of storage medium.
구동부(230)는 구동 신호에 의해 상기 무인 이동체(200)의 이동 방향 및 이동 속도를 제어할 수 있으며, 무인 이동체(200)의 이동 방향을 제어하기 위한 조향 수단과 이동 속도를 제어할 수 있는 가속 수단 및 감속 수단과 무인 이동체(200)를 이동시킬 수 있는 동력원을 제공하는 엔진 또는 전기 모터를 포함할 수 있다. The driver 230 can control the moving direction and moving speed of the unmanned mobile body 200 by a driving signal, and a steering means for controlling the moving direction of the unmanned mobile body 200 and acceleration capable of controlling the moving speed It may include an engine or an electric motor that provides a power source capable of moving the means and deceleration means and the unmanned mobile body 200 .
프로세서(235)는 상기 획득된 위치 정보로부터 목적지까지의 경로를 획득하고, 상기 무인 이동체를 상기 획득된 경로에 기반하여 이동하도록 상기 구동 신호를 발생시키고, 상기 경로를 이동하는 중에 광고 수용자가 존재한다면, 상기 광고 수용자 분류 모델을 이용하여 상기 획득된 영상 데이터로부터 상기 광고 수용자를 식별하고, 상기 식별된 광고 수용자 별로 광고를 표시하도록 상기 표시부(210)를 제어한다. The processor 235 obtains a route from the obtained location information to a destination, generates the driving signal to move the unmanned vehicle based on the obtained route, and if there is an advertisement receiver while moving on the route, the processor 235 , The advertisement receiver is identified from the obtained image data using the advertisement receiver classification model, and the display unit 210 is controlled to display an advertisement for each identified advertisement receiver.
구체적으로, 상기 프로세서(235)는 상기 광고 수용자에 대한 영상 분석 결과, 상기 광고 수용자가 이동 중이라면, 상기 광고 수용자의 이동 방향 및 이동 속도에 따라 상기 무인 이동체(200)의 이동을 제어하기 위해 상기 구동 신호를 발생시킬 수 있다. Specifically, the processor 235 controls the movement of the unmanned mobile body 200 according to the movement direction and speed of the advertisement recipient when the advertisement recipient is moving as a result of video analysis of the advertisement recipient. A drive signal can be generated.
또한, 상기 프로세서(235)는 상기 경로를 이동하는 중에 상기 광고 수용자가 존재한다면, 상기 광고 수용자가 있는 위치로, 상기 무인 이동체(200)를 이동 시키기 위한 상기 구동 신호를 발생시킬 수 있다. In addition, the processor 235 may generate the driving signal for moving the unmanned mobile body 200 to a location where the advertisement acceptor is present while moving along the path.
또한, 상기 프로세서(235)는 상기 분류된 광고 수용자 별로, 상기 광고주가 제공하도록 설정한 광고 컨텐츠를 제공하도록 상기 표시부(210)를 제어할 수 있다. Also, the processor 235 may control the display unit 210 to provide advertisement contents set to be provided by the advertiser for each of the classified advertisement recipients.
또한, 상기 프로세서(235)는 상기 광고 수용자로부터 상기 광고 컨텐츠에 대한 피드백을 수신하고, 상기 수신된 피드백에 따라 상기 광고 수용자에게 미리 정해진 부가 서비스를 제공하도록 상기 표시부(210)를 제어할 수 있다. 예컨대, 상기 부가 서비스는 동영상 컨텐츠 시청, 인터넷 서비스, 상기 광고 컨텐츠에 대한 구매 정보 중 적어도 하나를 포함할 수 있다. In addition, the processor 235 may receive feedback on the advertisement content from the advertisement receiver, and control the display unit 210 to provide a predetermined additional service to the advertisement receiver according to the received feedback. For example, the supplementary service may include at least one of viewing video content, Internet service, and purchase information for the advertising content.
또한, 상기 프로세서(235)는 상기 광고 수용자에 대해 획득된 이미지 분석을 통해, 상기 광고 수용자의 시선 방향을 획득하고, 상기 광고 수용자 시선의 방향을 분석하고, 상기 광고 수용자의 시선이 상기 무인 이동체(200)에서 제공하는 광고를 시청하고 있다면, 상기 광고 수용자에게 상기 광고를 미리 정해진 시간 동안 계속 제공하고, 상기 미리 정해진 시간이 종료되면, 상기 부가 서비스를 상기 광고 수용자에게 제공하도록 상기 표시부(210)를 제어할 수 있다. In addition, the processor 235 obtains the gaze direction of the advertisement recipient through image analysis obtained with respect to the advertisement recipient, analyzes the direction of the gaze of the advertisement recipient, and determines whether the gaze of the advertisement recipient is the unmanned mobile body ( 200), the advertisement is continuously provided to the advertisement receiver for a predetermined time, and when the predetermined time is over, the display unit 210 is configured to provide the additional service to the advertisement receiver. You can control it.
센서부(240)는 상기 무인 이동체(200) 주변의 장애물 등의 객체를 센싱하고, 그 센싱된 정보를 프로세서(235)로 제공함으로써, 프로세서(235)가 무인 이동체(200)가 주변 장애물을 회피하면서 이동할 수 있도록 구동 신호를 발생시키게 할 수 있다. 센서부(240)는 초음파 센서, RADAR(RAdio Detection And Ranging) 센서 및 LiDAR(Light Detection And Ranging) 센서를 포함할 수 있다. The sensor unit 240 senses objects such as obstacles around the unmanned vehicle 200 and provides the sensed information to the processor 235, so that the processor 235 allows the unmanned vehicle 200 to avoid surrounding obstacles. It is possible to generate a driving signal to move while moving. The sensor unit 240 may include an ultrasonic sensor, a RAdio Detection And Ranging (RADAR) sensor, and a Light Detection And Ranging (LiDAR) sensor.
초음파 센서는 초음파 신호를 사용하여 무인 이동체(200)의 주변 물체들을 감지하도록 구성된 센서일 수 있다. 또한, 초음파 센서는 무인 이동체(200) 주변 물체들의 위치와 방향 및 거리를 감지하도록 구성될 수 있다. The ultrasonic sensor may be a sensor configured to detect surrounding objects of the unmanned mobile body 200 using ultrasonic signals. Also, the ultrasonic sensor may be configured to detect positions, directions, and distances of objects around the unmanned mobile body 200 .
RADAR 센서는 무선 신호를 사용하여 무인 이동체(200)의 주변 물체들을 감지하도록 구성된 센서일 수 있다. 또한, RADAR 센서는 무인 이동체(200) 주변 물체들의 방향, 속도 및 거리를 감지하도록 구성될 수 있다. The RADAR sensor may be a sensor configured to detect objects around the unmanned vehicle 200 using radio signals. In addition, the RADAR sensor may be configured to detect the direction, speed, and distance of objects around the unmanned vehicle 200.
LiDAR 센서는 레이저를 사용하여 무인 이동체(200)의 주변 물체들을 감지하도록 구성된 센서일 수 있다. 또한, LiDAR 센서는 무인 이동체(200) 주변 물체들의 위치, 방향, 속도 및 거리를 감지하도록 구성될 수 있다. The LiDAR sensor may be a sensor configured to detect surrounding objects of the unmanned vehicle 200 using a laser. In addition, the LiDAR sensor may be configured to detect the position, direction, speed, and distance of objects around the unmanned vehicle 200 .
도 3은 본 발명의 실시 예에 따른 서버(300)의 블록 구성도이다. 3 is a block diagram of a server 300 according to an embodiment of the present invention.
경로 설정부(305)는 상기 무인 이동체의 위치 정보 근처의 광고 수용자 집단의 존재를 확인하고, 상기 광고 수용자 집단의 위치를 상기 목적지로 설정하고, 상기 무인 이동체의 위치 정보로부터 상기 목적지까지의 경로를 계산하고, 상기 계산된 경로를 상기 통신부를 통해 상기 무인 이동체(100, 200)로 송신한다. 상기 경로 설정부(305)는 상기 광고 수용자 집단이 복수 개라면, 상기 목적지로 설정된 광고 수용자 집단 외의 다른 광고 수용자 집단은 상기 경로의 경유지로 설정할 수 있다. The route setting unit 305 checks the existence of a group of advertisement recipients near the location information of the unmanned mobile vehicle, sets the location of the group of advertisement recipients as the destination, and calculates a route from the location information of the unmanned vehicle to the destination. It calculates and transmits the calculated path to the unmanned mobile body 100 or 200 through the communication unit. If the number of advertisement acceptor groups is plural, the route setting unit 305 may set another advertisement acceptor group other than the advertisement acceptor group set as the destination as a stopover of the route.
영상 획득부(310)는 상기 무인 이동체 또는 상기 지도 데이터 상에서 상기 무인 이동체의 위치 정보를 기준으로 소정 반경 이내에 위치한 카메라들로부터 상기 영상 데이터를 획득한다. The image acquisition unit 310 acquires the image data from cameras located within a predetermined radius based on location information of the unmanned mobile body or the unmanned mobile body on the map data.
학습 데이터 생성부(315)는 상기 무인 이동체(100, 200)로부터 획득된 영상 데이터를 이용하여 상기 광고 수용자를 분류하기 위한 학습용 데이터를 생성한다. The learning data generation unit 315 generates learning data for classifying the advertisement recipients using image data obtained from the unmanned mobile vehicles 100 and 200 .
광고 수용자 분류 모델 생성부(320)는 상기 생성된 학습 데이터를 이용하여 상기 광고 수용자 분류 모델을 생성하고, 네트워크를 통해 상기 무인 이동체로 상기 광고 수용자 분류 모델을 제공한다. The advertisement recipient classification model generation unit 320 generates the advertisement recipient classification model using the generated learning data, and provides the advertisement recipient classification model to the unmanned mobile vehicle through a network.
영상 분석부(325)는 상기 획득된 영상 데이터의 영상 분석을 통해 상기 영상 데이터 내에 상기 광고 수용자들을 식별하고, 상기 식별된 광고 수용자의 수가 미리 설정된 수 이상이라면, 상기 광고 수용자들을 상기 광고 수용자 집단으로 결정한다. The image analyzer 325 identifies the advertisement recipients in the image data through image analysis of the acquired image data, and if the number of the identified advertisement recipients is greater than or equal to a preset number, the advertisement recipients are classified as the advertisement recipient group. Decide.
광고 제공부(330)는 광고주가 광고 수용자들에게 제공하길 원하는 광고를 저장하며, 광고 수용자의 피드백을 반영하여 광고 수용자에게 제공할 광고를 변경할 수도 있다. The advertisement providing unit 330 stores advertisements that advertisers want to provide to advertisement receivers, and may change advertisements to be provided to advertisement receivers by reflecting feedback from advertisement receivers.
도 4는 본 발명의 실시 예에 따라 무인 이동체(200)에서의 광고 제공 방법을 나타낸 흐름도이다. 4 is a flowchart illustrating a method of providing advertisements in an unmanned mobile vehicle 200 according to an embodiment of the present invention.
도 4를 참고하면, 본 발명의 실시 예에 따른 무인 이동체(100, 200)는 현재 위치를 측위한 후(S105), 지도 데이터를 수신하여 지도 데이터 상의 자신의 위치를 확인할 수 있다(S110). 그리고, 무인 이동체(100, 200)는 영상 데이터를 획득(S115)하고, 경로가 설정되면(S120), 설정된 경로에 따라 이동(S125)한다. 이때 상기 경로는, 서버(150)에 의해 결정될 수 있다. 예컨대, 서버(150)가 상기 무인 이동체(100, 200)의 위치 정보 근처의 광고 수용자 집단의 존재를 확인하면, 상기 광고 수용자 집단의 위치를 목적지로 설정하고, 상기 무인 이동체(100, 200)의 위치 정보로부터 상기 목적지(광고 수용자 집단의 위치)까지의 경로를 계산한 후, 무인 이동체(100, 200)로 전달할 수 있다. 물론, 무인 이동체(100, 200)는 사전에 저장된 경로를 따라 이동할 수도 있다. Referring to FIG. 4 , the unmanned mobile vehicles 100 and 200 according to the embodiment of the present invention measure their current location (S105), and then receive map data to confirm their location on the map data (S110). Then, the unmanned mobile bodies 100 and 200 acquire image data (S115), and when a path is set (S120), they move according to the set path (S125). At this time, the path may be determined by the server 150. For example, when the server 150 confirms the existence of a group of advertisement recipients near the location information of the unmanned mobile bodies 100 and 200, it sets the location of the group of advertisement recipients as a destination, and After calculating the route from the location information to the destination (the location of the advertisement receiver group), it can be transmitted to the unmanned mobile bodies 100 and 200. Of course, the unmanned mobile bodies 100 and 200 may move along a pre-stored path.
만약, 상기 획득된 영상 데이터에 대한 영상 처리를 통해 경로 상에 장애물이 존재하는 것으로 판단되면(S130의 "예"), 무인 이동체(100, 200)는 회피 경로를 탐색하고(S135), 경로 상에 장애물이 존재하지 않는다고 판단되면(S130의 "아니오"), 경로 주변 광고 수용자가 존재하는지 판단한다(S140). 경로 주변 광고 수용자가 존재하면(S140의 "예"), 무인 이동체(100, 200)는 광고 수용자 방향으로 이동하고(S145), 광고 수용자를 식별한 후, 식별된 광고 수용자 별로 광고를 제공한다(S150). If, through image processing of the acquired image data, it is determined that there is an obstacle on the path (Yes in S130), the unmanned mobile bodies 100 and 200 search for an avoidance path (S135), If it is determined that there is no obstacle in (S130 'No'), it is determined whether there are advertisement receivers around the route (S140). If there are advertisement recipients around the path (Yes in S140), the unmanned mobile bodies 100 and 200 move in the direction of the advertisement recipient (S145), identify the advertisement recipient, and provide advertisements for each identified advertisement recipient (S145). S150).
무인 이동체(100, 200)는 영상 처리를 통해 광고 수용자가 이동한다고 판단되면(S155의 "예"), 광고 수용자 이동 속도 및 이동 방향을 고려하여 이동하고(S160), 광고 수용자로부터 피드백이 수신되면(S165), 수신된 피드백에 대응한 서비스를 제공한다(S170). When the unmanned moving object 100, 200 determines that the advertisement recipient is moving through image processing (Yes in S155), it moves in consideration of the advertisement recipient's moving speed and movement direction (S160), and when feedback is received from the advertisement recipient (S165), a service corresponding to the received feedback is provided (S170).
도 5는 본 발명의 다른 실시 예에 따른 무인 이동체(100, 200)와 서버(150)간의 광고 제공 방법의 흐름도이다. 5 is a flowchart of a method for providing advertisements between the unmanned mobile vehicles 100 and 200 and the server 150 according to another embodiment of the present invention.
무인 이동체(100, 200)는 현재 위치를 판단하고(S205), 지도 데이터를 획득한다(S207), 반면, 서버(150)는 무인 이동체(100, 200)의 주위 영상 데이터를 획득하면(S210), 무인 이동체(100, 200)의 주위 광고 수용자 집단을 확인한다(S215), 구체적으로, 서버(150)는 상기 지도 데이터 상에서 상기 무인 이동체(100, 200)의 위치 정보를 기준으로 소정 반경 이내에 위치한 카메라들로부터 영상 데이터를 획득하고, 상기 획득한 영상 데이터의 영상 분석을 통해 상기 영상 데이터 내에 광고 수용자들을 식별한다. 그리고, 식별된 광고 수용자들의 수가 미리 설정된 수(예를 들어 10명) 이상이라면, 상기 광고 수용자들을 광고 수용자 집단으로 설정할 수 있다. 또한, 서버(150)는 상기 S215단계에서 확인된 광고 수용자 집단이 복수라면, 광고 수용자 집단에 포함된 광고 수용자 수를 기준으로 우선 순위를 설정할 수 있다(S220).The unmanned mobile bodies 100 and 200 determine the current location (S205) and obtain map data (S207). On the other hand, when the server 150 acquires the surrounding image data of the unmanned mobile bodies 100 and 200 (S210) , Checks a group of advertisement recipients around the unmanned mobile bodies 100 and 200 (S215). Specifically, the server 150 determines a location within a predetermined radius based on the location information of the unmanned mobile bodies 100 and 200 on the map data. Image data is obtained from cameras, and advertisement recipients are identified in the image data through image analysis of the obtained image data. In addition, if the number of identified advertisement recipients is greater than or equal to a preset number (eg, 10), the advertisement recipients may be set as an advertisement recipient group. In addition, if the number of advertisement acceptor groups identified in step S215 is plural, the server 150 may set a priority based on the number of advertisement acceptor groups included in the advertisement acceptor group (S220).
그리고, 서버(150)는 상기 S220단계에서 결정된 순서대로 광고를 제공하기 위한 무인 이동체(100, 200)의 이동 경로를 설정할 수 있다(S230). 예컨대, 목적지로 설정된 광고 수용자 집단을 제외한 다른 광고 수용자 집단은 상기 목적지까지 가는 경로의 경유지로 설정할 수 있다. Then, the server 150 may set the movement path of the unmanned mobile vehicles 100 and 200 to provide advertisements in the order determined in step S220 (S230). For example, other advertisement acceptor groups other than the advertisement acceptor group set as the destination may be set as waypoints of a route to the destination.
무인 이동체(100, 200)는 경로에 따라 이동하는 중(S235) 광고 수용자 집단을 발견하면(S240), 광고 수용자를 식별한다(S245). 그리고, 무인 이동체(100, 200)는 식별된 광고 수용자별로 광고를 제공하고(S250), 획득된 영상 데이터를 서버(150)로 전송(S252)하고. 서버(150)는 상기 전송된 영상 데이터를 이용하여 광고 수용자 식별을 위한 학습용 데이터를 갱신하여 광고 수용자 식별 학습 모델을 생성(S255)하고, 생성된 학습 모델을 무인 이동체(100, 200)로 전송한다(S257). While moving along the path (S235), the unmanned mobile bodies 100 and 200 find a group of advertisement recipients (S240), and identify the advertisement recipients (S245). Then, the unmanned mobile bodies 100 and 200 provide advertisements for each identified advertisement recipient (S250) and transmit the obtained image data to the server 150 (S252). The server 150 updates learning data for identifying advertisement recipients using the transmitted image data to generate an advertisement recipient identification learning model (S255), and transmits the generated learning model to the unmanned mobile bodies 100 and 200. (S257).
무인 이동체(100, 200)는 서버(150)로부터 생성된 학습 모델이 수신되면, 광고 수용자 식별 학습 모델을 갱신한다(S260).When the learning model generated by the server 150 is received, the unmanned mobile bodies 100 and 200 update the advertisement receiver identification learning model (S260).
도 6은 도 4의 S150단계를 상세히 설명하기 위한 방법 흐름도이다. 6 is a method flowchart for explaining step S150 of FIG. 4 in detail.
무인 이동체(100, 200)는 광고 수용자에 대한 영상을 획득하고(S305), 기계 학습 기반한 영상 분석을 수행하고(S310), 광고 수용자를 식별한다(S315). 그리고, 무인 이동체(100, 200)은 식별된 광고 수용자 별로 광고를 선택한다. 예컨대 본 발명의 실시 예에서는 광고 수용자를 남성, 여성, 성인, 아동 중 어느 하나로 식별할 수 있고, 식별된 광고 수용자에 따라 적합한 광고를 선택하여 제공할 수 있다. The unmanned mobile bodies 100 and 200 acquire images of advertisement recipients (S305), perform image analysis based on machine learning (S310), and identify advertisement recipients (S315). Then, the unmanned mobile bodies 100 and 200 select advertisements for each identified advertisement recipient. For example, in an embodiment of the present invention, an advertisement recipient may be identified as male, female, adult, or child, and an appropriate advertisement may be selected and provided according to the identified advertisement recipient.
도 7은 도 4의 S165단계를 상세히 설명하기 위한 방법 흐름도이다. FIG. 7 is a method flowchart for explaining step S165 of FIG. 4 in detail.
무인 이동체(100, 200)는 광고 수용자에 대한 영상이 획득되면(S405), 광고 수용자 시선을 분석하여(S410), 광고에 대한 광고 수용자의 관심을 측정한다(S415). 예컨대 광고 수용자의 시선이 일정 시간 이상 광고를 제공하는 표시부를 향하거 있거나, 광고 수용자가 무인 이동체(100, 200)의 이동 방향에 따라 이동하고 있을 경우, 본 발명의 실시 예에 따라 광고 수용자의 관심도가 높다고 판단할 수 있다. When an image of the advertisement recipient is obtained (S405), the unmanned mobile body 100 or 200 analyzes the gaze of the advertisement recipient (S410) and measures the advertisement recipient's interest in the advertisement (S415). For example, when the advertisement recipient's gaze is directed toward a display unit providing advertisements for a certain period of time or longer, or the advertisement recipient is moving in the moving direction of the unmanned moving object (100, 200), according to an embodiment of the present invention, the advertisement recipient's interest can be judged to be high.
무인 이동체(100, 200)는 광심도가 높다고 판단되면(S420의 "예"), 기존 광고를 계속 제공(S430)하고, 그렇지 않다면(S420의 "아니오"), 광고를 변경한다(S425).If it is determined that the optical depth is high (Yes in S420), the unmanned mobile bodies 100 and 200 continue to provide the existing advertisement (S430), and if not (No in S420), change the advertisement (S425).
그리고, 무인 이동체(100, 200)는 미리 정해진 시간 동안 광고를 광고 수용자에게 제공하고(S435), 광고 수용자로부터 부가 서비스 제공이 요청되었다면(S440), 부가 서비스를 제공한다(S445). 본 발명의 실시 예에 따른 부가 서비스는, 동영상 컨텐츠 시청, 인터넷 서비스, 상기 광고에 대한 구매 정보 등이 될 수 있다. Then, the unmanned mobile bodies 100 and 200 provide advertisements to advertisement recipients for a predetermined period of time (S435), and when additional services are requested from advertisement recipients (S440), additional services are provided (S445). An additional service according to an embodiment of the present invention may be video content viewing, internet service, purchase information for the advertisement, and the like.
도 8은 본 발명의 다른 실시 예에 따른 무인 이동체(100, 200)의 광고 제공 방법 흐름도이다. 8 is a flowchart of an advertisement providing method of unmanned mobile bodies 100 and 200 according to another embodiment of the present invention.
무인 이동체(100, 200)는 복수의 광고 수용자 집단이 존재한다면(S505), 광고 수용자들의 밀집도를 판단하고(S510), 밀집도가 높은 순으로 이동할 수 있다. 그리고, 무인 이동체(100, 200)는 광고 수용 대상자를 분류한 후(S520), 그 분류 결과에 따른 광고 서비스를 제공한다(S525). If there are a plurality of advertisement receiver groups (S505), the unmanned mobile bodies 100 and 200 may determine the density of the advertisement receivers (S510) and move in order of higher density. And, after the unmanned mobile bodies 100 and 200 classify advertisement recipients (S520), they provide advertisement services according to the classification result (S525).
도 9는 본 발명의 실시 예에 따른 서버(150)에서의 광고 제공 방법 흐름도이다. 9 is a flowchart of a method for providing advertisements in the server 150 according to an embodiment of the present invention.
서버(150)는 광고 수용자들에게 제공할 광고를 저장하고(S600), 광고주로부터 광고를 제공할 광고 수용자 대상을 입력받은 후(S605) 광고 수용자 대상 정보를 무인 이동체(100, 200)로 전달한다(S610). 그리고, 서버(150)는 광고 수용자들로부터 피드백 정보를 획득하고(S615), 획득된 피드백 정보를 광고주에게 제공한다(S620). The server 150 stores advertisements to be provided to advertisement recipients (S600), receives an input of advertisement recipients to provide advertisements from the advertiser (S605), and delivers the advertisement recipient target information to the unmanned mobile bodies 100 and 200. (S610). Then, the server 150 obtains feedback information from advertisement recipients (S615) and provides the obtained feedback information to the advertiser (S620).
도 10은 본 발명의 다른 실시 예에 따른 무인 이동체(100, 200)의 광고 제공 방법 흐름도이다. 10 is a flowchart of a method of providing advertisements for unmanned mobile vehicles 100 and 200 according to another embodiment of the present invention.
무인 이동체(100, 200)는 현재 위치를 측정한 후(S700), 지도 데이터를 수신하고(S705), 경로를 수신한다(S710). 그리고, 무인 이동체(100, 200)는 광고 수용자 대상 정보를 수신하고(S715), 경로 이동하면서 주변 영상을 획득하면서(S720), 광고 수용자가 검출되는지 판단한다(S725). 그리고, 무인 이동체(100, 200)는 광고 수용자가 검출되면(S725, "예"), 검출된 위치로 이동하고(S730), 광고를 제공한다(S735). 또한, 무인 이동체(100, 200)는 광고 수용자 피드백이 획득되면(S740), 획득된 피드백을 서버(150)로 전달하고(S745), 광고 제공이 종료되었는지를 판단한다(S750). The unmanned mobile bodies 100 and 200 measure the current location (S700), receive map data (S705), and receive a route (S710). In addition, the unmanned mobile bodies 100 and 200 receive advertisement recipient target information (S715), acquire surrounding images while moving along the route (S720), and determine whether an advertisement recipient is detected (S725). Then, when an advertisement recipient is detected (S725, Yes), the unmanned mobile bodies 100 and 200 move to the detected location (S730) and provide advertisements (S735). In addition, when the advertisement receiver feedback is obtained (S740), the unmanned mobile bodies 100 and 200 transmit the obtained feedback to the server 150 (S745) and determine whether provision of the advertisement has ended (S750).
무인 이동체(100, 200)는 광고 제공이 종료되었다면(S750의 "예"), 광고를 중단하고, 원래 경로 위치로 복귀한다(S755). The unmanned mobile bodies 100 and 200 stop the advertisement and return to the original path position when the provision of the advertisement is terminated (Yes in S750) (S755).
본 발명은 이동형 로봇 장치를 이용하여 광고를 수행할 때, 광고를 관리하는 분야, 예를 들어, 광고의 효과를 측정하거나 광고 제공하는 것 등에 이용될 수 있다.The present invention can be used in the field of managing advertisements when performing advertisements using a mobile robot device, for example, measuring the effectiveness of advertisements or providing advertisements.

Claims (19)

  1. 무인 이동체에서의 광고 제공 방법에 있어서, A method for providing advertisements in an unmanned mobile vehicle,
    상기 무인 이동체의 위치 정보를 획득하는 단계;obtaining location information of the unmanned mobile vehicle;
    상기 획득된 위치 정보에 해당하는 지도 데이터를 획득하는 단계;acquiring map data corresponding to the acquired location information;
    상기 무인 이동체 주변의 영상 데이터를 획득하는 단계;obtaining image data around the unmanned vehicle;
    상기 획득된 위치 정보로부터 목적지까지의 경로를 획득하는 단계;obtaining a route to a destination from the obtained location information;
    상기 획득된 경로에 기반하여 이동하는 단계;moving based on the acquired path;
    상기 경로를 이동하는 중에 광고 수용자가 존재한다면, 상기 획득된 영상데이터로부터 상기 광고 수용자를 식별하는 단계; 및 identifying the advertisement recipient from the obtained image data, if there is an advertisement recipient while moving along the path; and
    상기 식별된 광고 수용자 별로 광고를 표시하는 단계;displaying an advertisement for each of the identified advertisement recipients;
    를 포함하는 무인 이동체에서의 광고 제공 방법. An advertisement providing method in an unmanned mobile vehicle comprising a.
  2. 제1항에 있어서, 상기 획득된 위치 정보로부터 목적지까지의 경로를 획득하는 단계는, The method of claim 1, wherein obtaining a route to a destination from the obtained location information comprises:
    상기 무인 이동체의 위치 정보 근처의 광고 수용자 집단의 존재를 확인하는 단계;confirming existence of a group of advertisement recipients near the location information of the unmanned mobile vehicle;
    상기 광고 수용자 집단의 위치를 상기 목적지로 설정하는 단계; 및setting the location of the advertisement recipient group as the destination; and
    상기 무인 이동체의 위치 정보로부터 상기 목적지까지의 경로를 계산하는 단계;calculating a path to the destination from location information of the unmanned vehicle;
    를 포함하는 무인 이동체에서의 광고 제공 방법. An advertisement providing method in an unmanned mobile vehicle comprising a.
  3. 제2항에 있어서, 상기 광고 수용자 집단의 존재를 확인하는 단계는, The method of claim 2, wherein the step of confirming the presence of a group of advertisement recipients comprises:
    상기 지도 데이터 상에서 상기 무인 이동체의 위치 정보를 기준으로 소정 반경 이내에 위치한 카메라들로부터 영상 데이터를 획득하는 단계;obtaining image data from cameras located within a predetermined radius based on location information of the unmanned vehicle on the map data;
    상기 획득된 영상 데이터의 영상 분석을 통해 상기 영상 데이터 내에 상기 광고 수용자들을 식별하는 단계; 및identifying the advertisement recipients within the image data through image analysis of the obtained image data; and
    상기 식별된 광고 수용자의 수가 미리 설정된 수 이상이라면, 상기 광고 수용자들을 상기 광고 수용자 집단으로 결정하는 단계;if the number of the identified advertisement recipients is equal to or greater than a preset number, determining the advertisement recipients as the advertisement recipient group;
    를 포함하는 무인 이동체에서의 광고 제공 방법. An advertisement providing method in an unmanned mobile vehicle comprising a.
  4. 제2항에 있어서, 상기 무인 이동체의 위치 정보로부터 상기 목적지까지의 경로를 계산하는 단계는,The method of claim 2, wherein calculating a path to the destination from location information of the unmanned vehicle comprises:
    상기 광고 수용자 집단이 복수 개라면, 상기 목적지로 설정된 광고 수용자 집단 외의 다른 광고 수용자 집단은 상기 경로의 경유지로 설정하는 단계;setting an advertisement acceptor group other than the advertisement acceptor group set as the destination as a stopover of the route if the advertisement acceptor group is plural;
    를 더 포함함을 특징으로 하는 무인 이동체에서의 광고 제공 방법. Advertisement providing method in an unmanned mobile vehicle, characterized in that it further comprises.
  5. 제3항에 있어서, 상기 광고 수용자는, The method of claim 3, wherein the advertisement acceptor,
    광고주에 의해 광고를 수용할 대상들로 결정되며, 상기 획득된 영상 데이터를 머신 러닝 기반의 학습 모델을 이용하여 남성, 여성, 성인, 아동 중 어느 하나의 대상들로 분류됨Targets to accept advertisements are determined by the advertiser, and the obtained image data is classified into any one of male, female, adult, and child targets using a machine learning-based learning model.
    을 특징으로 하는 무인 이동체에서의 광고 제공 방법. A method for providing advertisements in an unmanned mobile vehicle.
  6. 제5항에 있어서,According to claim 5,
    상기 광고 수용자에 대한 영상 분석 결과, 상기 광고 수용자가 이동 중이라면, 상기 광고 수용자의 이동 방향 및 이동 속도에 따라 상기 무인 이동체의 이동을 제어하는 단계Controlling the movement of the unmanned mobile body according to the movement direction and speed of the advertisement recipient when the advertisement recipient is moving as a result of the video analysis of the advertisement recipient
    를 더 포함하는 무인 이동체에서의 광고 제공 방법. An advertisement providing method in an unmanned mobile vehicle further comprising a.
  7. 제5항에 있어서,According to claim 5,
    상기 경로를 이동하는 중에 광고 수용자가 존재한다면, 상기 광고 수용자가 있는 위치로, 상기 무인 이동체를 이동 시키는 단계Moving the unmanned vehicle to a location where the advertisement acceptor is located, if there is an advertisement acceptor while moving on the route
    를 더 포함하는 무인 이동체에서의 광고 제공 방법. An advertisement providing method in an unmanned mobile vehicle further comprising a.
  8. 제5항에 있어서,According to claim 5,
    상기 분류된 광고 수용자 별로, By the above classified advertisement recipients,
    상기 광고주가 제공하도록 설정한 광고 컨텐츠를 제공하는 단계Step of providing advertising content set to be provided by the advertiser
    를 더 포함하는 무인 이동체에서의 광고 제공 방법. An advertisement providing method in an unmanned mobile vehicle further comprising a.
  9. 제8항에 있어서,According to claim 8,
    상기 광고 수용자로부터 상기 광고 컨텐츠에 대한 피드백을 수신하는 단계; 및receiving feedback on the advertisement content from the advertisement receiver; and
    상기 수신된 피드백에 따라 상기 광고 수용자에게 미리 정해진 부가 서비스를 제공하는 단계Providing a predetermined supplementary service to the advertisement recipient according to the received feedback
    를 더 포함하고,Including more,
    상기 부가 서비스는, The additional service,
    동영상 컨텐츠 시청, 인터넷 서비스, 상기 광고 컨텐츠에 대한 구매 정보 중 적어도 하나를 포함하는 무인 이동체에서의 광고 제공 방법. A method of providing advertisements in an unmanned mobile vehicle including at least one of viewing video contents, internet service, and purchase information for the advertisement contents.
  10. 제9항에 있어서, 상기 광고 수용자로부터 상기 광고 컨텐츠에 대한 피드백을 수신하는 단계는,The method of claim 9, wherein receiving feedback on the advertisement content from the advertisement acceptor comprises:
    상기 광고 수용자에 대해 획득된 이미지 분석을 통해, 상기 광고 수용자의 시선 방향을 획득하는 단계;obtaining a gaze direction of the advertisement recipient through image analysis obtained with respect to the advertisement recipient;
    상기 광고 수용자 시선의 방향을 분석하는 단계; 및analyzing the direction of the gaze of the advertisement recipient; and
    상기 광고 수용자의 시선이 상기 무인 이동체에서 제공하는 광고를 시청하고 있다면, 상기 광고 수용자에게 상기 광고를 미리 정해진 시간 동안 계속 제공하고, 상기 미리 정해진 시간이 종료되면, 상기 부가 서비스를 상기 광고 수용자에게 제공하는 단계;If the gaze of the advertisement receiver is watching the advertisement provided by the unmanned mobile vehicle, the advertisement is continuously provided to the advertisement receiver for a predetermined time, and when the predetermined time is over, the additional service is provided to the advertisement receiver. doing;
    를 포함하는 무인 이동체에서의 광고 제공 방법.An advertisement providing method in an unmanned mobile vehicle comprising a.
  11. 무인 이동체에서의 광고 제공 시스템에 있어서, In an advertisement providing system in an unmanned mobile vehicle,
    외부 서버와 통신하는 통신부;a communication unit that communicates with an external server;
    표시부;display unit;
    상기 무인 이동체 외부의 영상 데이터를 획득하는 카메라;a camera acquiring image data of the outside of the unmanned vehicle;
    상기 무인 이동체의 위치 정보를 획득하는 위치 정보 획득부;a location information acquisition unit acquiring location information of the unmanned mobile vehicle;
    학습 기반의 광고 수용자 분류 모델과 상기 획득된 위치 정보에 해당하는 지도 데이터를 저장하는 메모리; a memory for storing a learning-based advertisement recipient classification model and map data corresponding to the obtained location information;
    구동 신호에 의해 상기 무인 이동체의 이동 방향 및 이동 속도를 제어하는 구동부; 및a driving unit controlling a moving direction and a moving speed of the unmanned mobile body by a driving signal; and
    상기 획득된 위치 정보로부터 목적지까지의 경로를 획득하고, 상기 무인 이동체를 상기 획득된 경로에 기반하여 이동하도록 상기 구동 신호를 발생시키고, 상기 경로를 이동하는 중에 광고 수용자가 존재한다면, 상기 광고 수용자 분류 모델을 이용하여 상기 획득된 영상 데이터로부터 상기 광고 수용자를 식별하고, 상기 식별된 광고 수용자 별로 광고를 표시하도록 상기 표시부를 제어하는 프로세서;를 A route to a destination is obtained from the acquired location information, the driving signal is generated to move the unmanned vehicle based on the obtained route, and if an advertisement acceptor exists while moving on the route, the advertisement acceptor is classified. a processor for controlling the display unit to identify the advertisement recipients from the obtained image data using a model and to display advertisements for each of the identified advertisement recipients;
    포함하는 무인 이동체에서의 광고 표시 시스템. An advertisement display system in an unmanned mobile vehicle comprising:
  12. 제11항에 있어서, According to claim 11,
    상기 외부 서버는, The external server,
    상기 무인 이동체의 위치 정보 근처의 광고 수용자 집단의 존재를 확인하고, 상기 광고 수용자 집단의 위치를 상기 목적지로 설정하고, 상기 무인 이동체의 위치 정보로부터 상기 목적지까지의 경로를 계산하고, 상기 계산된 경로를 상기 통신부를 통해 상기 무인 이동체로 송신하는 경로 설정부;The existence of a group of advertisement recipients near the location information of the unmanned mobile vehicle is confirmed, the location of the group of advertisement recipients is set as the destination, a route to the destination is calculated from the location information of the unmanned vehicle, and the calculated route a path setting unit for transmitting to the unmanned mobile body through the communication unit;
    상기 무인 이동체 또는 상기 지도 데이터 상에서 상기 무인 이동체의 위치 정보를 기준으로 소정 반경 이내에 위치한 카메라들로부터 상기 영상 데이터를 획득하는 영상 획득부;an image acquiring unit acquiring the image data from cameras located within a predetermined radius based on location information of the unmanned mobile body or the unmanned mobile body on the map data;
    상기 무인 이동체로부터 획득된 영상 데이터를 이용하여 상기 광고 수용자를 분류하기 위한 학습용 데이터를 생성하는 학습 데이터 생성부;a learning data generation unit generating learning data for classifying the advertisement recipients using image data acquired from the unmanned mobile vehicle;
    상기 생성된 학습 데이터를 이용하여 상기 광고 수용자 분류 모델을 생성하고, 네트워크를 통해 상기 무인 이동체로 상기 광고 수용자 분류 모델을 제공하는 광고 수용자 분류 모델 생성부; 및an advertisement receiver classification model generation unit generating the advertisement receiver classification model using the generated learning data and providing the advertisement receiver classification model to the unmanned mobile vehicle through a network; and
    상기 획득된 영상 데이터의 영상 분석을 통해 상기 영상 데이터 내에 상기 광고 수용자들을 식별하고, 상기 식별된 광고 수용자의 수가 미리 설정된 수 이상이라면, 상기 광고 수용자들을 상기 광고 수용자 집단으로 결정하는 영상 분석부;a video analyzer configured to identify the advertisement recipients in the image data through video analysis of the acquired image data, and to determine the advertisement recipients as the advertisement recipient group if the number of the identified advertisement recipients is greater than or equal to a preset number;
    를 포함하는 무인 이동체에서의 광고 제공 시스템. An advertisement providing system in an unmanned mobile vehicle comprising a.
  13. 제12항에 있어서, 상기 경로 설정부는,The method of claim 12, wherein the route setting unit,
    상기 광고 수용자 집단이 복수 개라면, 상기 목적지로 설정된 광고 수용자 집단 외의 다른 광고 수용자 집단은 상기 경로의 경유지로 설정하는 것을 특징으로 하는 무인 이동체에서의 광고 제공 시스템. and if there are a plurality of the advertisement acceptor groups, another advertisement acceptor group other than the advertisement acceptor group set as the destination is set as a stopover of the route.
  14. 제13항에 있어서, 상기 광고 수용자는, The method of claim 13, wherein the advertisement acceptor,
    광고주에 의해 광고를 수용할 대상들로 결정되며, 상기 획득된 영상 데이터를 머신 러닝 기반의 학습 모델을 이용하여 남성, 여성, 성인, 아동 중 어느 하나의 대상들로 분류됨을 특징으로 하는 무인 이동체에서의 광고 제공 시스템. In an unmanned mobile vehicle, which is determined by the advertiser as targets to accept advertisements, and the obtained image data is classified into any one of male, female, adult, and child targets using a machine learning-based learning model. 's advertising delivery system.
  15. 제14항에 있어서,According to claim 14,
    상기 프로세서는,the processor,
    상기 광고 수용자에 대한 영상 분석 결과, 상기 광고 수용자가 이동 중이라면, 상기 광고 수용자의 이동 방향 및 이동 속도에 따라 상기 무인 이동체의 이동을 제어하기 위해 상기 구동 신호를 발생시킴을 특징으로 하는 무인 이동체에서의 광고 제공 시스템. As a result of video analysis of the advertisement recipient, if the advertisement recipient is moving, the driving signal is generated to control the movement of the unmanned mobile body according to the moving direction and moving speed of the advertisement recipient. 's advertising delivery system.
  16. 제15항에 있어서,According to claim 15,
    상기 프로세서는, the processor,
    상기 경로를 이동하는 중에 상기 광고 수용자가 존재한다면, 상기 광고 수용자가 있는 위치로, 상기 무인 이동체를 이동 시키기 위한 상기 구동 신호를 발생시킴을 특징으로 하는 무인 이동체에서의 광고 제공 시스템. and generating the driving signal for moving the unmanned mobile body to a position where the advertisement receiver is located, if the advertisement receiver exists while moving on the path.
  17. 제15항에 있어서,According to claim 15,
    상기 프로세서는,the processor,
    상기 분류된 광고 수용자 별로, 상기 광고주가 제공하도록 설정한 광고 컨텐츠를 제공하도록 상기 표시부를 제어함을 특징으로 하는 무인 이동체에서의 광고 제공 시스템. and controlling the display unit to provide advertisement contents set by the advertiser for each of the classified advertisement recipients.
  18. 제17항에 있어서,According to claim 17,
    상기 프로세서는,the processor,
    상기 광고 수용자로부터 상기 광고 컨텐츠에 대한 피드백을 수신하고, 상기 수신된 피드백에 따라 상기 광고 수용자에게 미리 정해진 부가 서비스를 제공함을 특징으로 하고, Receiving feedback on the advertisement content from the advertisement receiver, and providing a predetermined additional service to the advertisement receiver according to the received feedback,
    상기 부가 서비스는, The additional service,
    동영상 컨텐츠 시청, 인터넷 서비스, 상기 광고 컨텐츠에 대한 구매 정보 중 적어도 하나를 포함하는 무인 이동체에서의 광고 제공 시스템. A system for providing advertisements in an unmanned mobile vehicle including at least one of viewing video contents, internet service, and purchase information for the advertisement contents.
  19. 제18항에 있어서, According to claim 18,
    상기 프로세서는, the processor,
    상기 광고 수용자에 대해 획득된 이미지 분석을 통해, 상기 광고 수용자의 시선 방향을 획득하고, 상기 광고 수용자 시선의 방향을 분석하고, 상기 광고 수용자의 시선이 상기 무인 이동체에서 제공하는 광고를 시청하고 있다면, 상기 광고 수용자에게 상기 광고를 미리 정해진 시간 동안 계속 제공하고, 상기 미리 정해진 시간이 종료되면, 상기 부가 서비스를 상기 광고 수용자에게 제공함을 특징으로 하는 무인 이동체에서의 광고 제공 시스템.Through image analysis obtained for the advertisement recipient, the gaze direction of the advertisement recipient is obtained, the gaze direction of the advertisement recipient is analyzed, and if the gaze of the advertisement recipient is watching the advertisement provided by the unmanned mobile device, The advertisement providing system in an unmanned mobile vehicle, characterized in that the advertisement is continuously provided to the advertisement receiver for a predetermined time period, and the additional service is provided to the advertisement receiver when the predetermined time period is over.
PCT/KR2022/016398 2021-11-01 2022-10-26 Method and system for providing advertisement on unmanned vehicle WO2023075383A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020210148043A KR102683736B1 (en) 2021-11-01 2021-11-01 Method for providing advertisement in unmanned moving object and system thereof
KR10-2021-0148043 2021-11-01

Publications (1)

Publication Number Publication Date
WO2023075383A1 true WO2023075383A1 (en) 2023-05-04

Family

ID=86159812

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2022/016398 WO2023075383A1 (en) 2021-11-01 2022-10-26 Method and system for providing advertisement on unmanned vehicle

Country Status (2)

Country Link
KR (1) KR102683736B1 (en)
WO (1) WO2023075383A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050065652A1 (en) * 2003-09-22 2005-03-24 Honda Motor Co., Ltd. Autonomously moving robot management system
KR20130061104A (en) * 2011-11-30 2013-06-10 제너럴 일렉트릭 캄파니 Usage measurement techniques and systems for interactive advertising
KR101854431B1 (en) * 2016-11-15 2018-05-03 주식회사 로보러스 Concierge robot
KR20210046451A (en) * 2019-10-18 2021-04-28 네이버랩스 주식회사 Method and system for interaction between robot and user
KR102288870B1 (en) * 2021-02-19 2021-08-12 주식회사 튠미디어 Advertising system using ai robot and server controlling ai robot

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050065652A1 (en) * 2003-09-22 2005-03-24 Honda Motor Co., Ltd. Autonomously moving robot management system
KR20130061104A (en) * 2011-11-30 2013-06-10 제너럴 일렉트릭 캄파니 Usage measurement techniques and systems for interactive advertising
KR101854431B1 (en) * 2016-11-15 2018-05-03 주식회사 로보러스 Concierge robot
KR20210046451A (en) * 2019-10-18 2021-04-28 네이버랩스 주식회사 Method and system for interaction between robot and user
KR102288870B1 (en) * 2021-02-19 2021-08-12 주식회사 튠미디어 Advertising system using ai robot and server controlling ai robot

Also Published As

Publication number Publication date
KR102683736B1 (en) 2024-07-10
KR20230063129A (en) 2023-05-09

Similar Documents

Publication Publication Date Title
Fernandes et al. A review of assistive spatial orientation and navigation technologies for the visually impaired
WO2019209057A1 (en) Method of determining position of vehicle and vehicle using the same
WO2020060308A1 (en) Electronic device and vehicle control method of electronic device, server and method for providing precise map data of server
WO2018052204A1 (en) Airport robot and airport robot system comprising same
EP3668768A1 (en) Device and method for assisting with driving of vehicle
US11138844B2 (en) Artificial intelligence apparatus and method for detecting theft and tracing IoT device using same
KR101711797B1 (en) Automatic parking system for autonomous vehicle and method for controlling thereof
CN103562678A (en) Mobile body navigation device, and mobile body navigation system
JP6792160B2 (en) Movement support system, movement support device, movement support terminal, movement support method, map creation system, map creation device, and information acquisition terminal
WO2021241847A1 (en) Method and system for generating visual feature map
US20190107402A1 (en) Navigation device, destination guiding system, and non-transitory recording medium
CN111353522A (en) Method and system for determining road signs in the surroundings of a vehicle
JP2020061062A (en) Driving support device, vehicle, driving support system, driving support method, and computer program for driving support
CN112106003A (en) Controller, control method, and program
WO2021162205A1 (en) Method, apparatus, server, and computer program for collision accident prevention
US10249192B2 (en) Notification regarding an estimated movement path of a vehicle
US11210948B2 (en) Vehicle and notification method
KR20140064424A (en) Apparatus and method for recognizing position of car
US20220281486A1 (en) Automated driving vehicle, vehicle allocation management device, and terminal device
WO2013039273A1 (en) Driving apparatus and method using 3d sensor
WO2023075383A1 (en) Method and system for providing advertisement on unmanned vehicle
CN110741425A (en) Map updating device, map updating system, map updating method, and program
CN116075695A (en) Mobile assistance device and method for providing mobile assistance
WO2021201304A1 (en) Method and device for assisting autonomous driving
US20230298340A1 (en) Information processing apparatus, mobile object, control method thereof, and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22887579

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE