WO2021038725A1 - Terminal de communication, procédé de communication, et programme de communication - Google Patents

Terminal de communication, procédé de communication, et programme de communication Download PDF

Info

Publication number
WO2021038725A1
WO2021038725A1 PCT/JP2019/033557 JP2019033557W WO2021038725A1 WO 2021038725 A1 WO2021038725 A1 WO 2021038725A1 JP 2019033557 W JP2019033557 W JP 2019033557W WO 2021038725 A1 WO2021038725 A1 WO 2021038725A1
Authority
WO
WIPO (PCT)
Prior art keywords
communication
transmission right
user
communication terminal
image
Prior art date
Application number
PCT/JP2019/033557
Other languages
English (en)
Japanese (ja)
Inventor
平岡　秀一
克己 横道
和昭 沖本
Original Assignee
株式会社サイエンスアーツ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社サイエンスアーツ filed Critical 株式会社サイエンスアーツ
Priority to PCT/JP2019/033557 priority Critical patent/WO2021038725A1/fr
Priority to JP2021541845A priority patent/JPWO2021038725A1/ja
Publication of WO2021038725A1 publication Critical patent/WO2021038725A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/06—Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
    • H04W4/10—Push-to-Talk [PTT] or Push-On-Call services

Definitions

  • the present invention relates to a communication terminal, a communication method, and a communication program.
  • PTT Push To Talk
  • PTT communication which is a half-duplex voice communication method, is known as a technology that realizes one-to-many group simultaneous voice communication.
  • a transceiver, a radio, and the like are used as terminals.
  • PTT communication while the user presses a call button provided on the terminal, the user can send voice to the other party forming the group.
  • PoC Push-to-Talk over Cellular
  • the communication terminal that has acquired the transmission right transmits the voice data to other communication terminals in a broadcast manner.
  • a communication terminal that uses PoC may be equipped with a VOX (Voice Operation Control) function.
  • VOX Voice Operation Control
  • a communication terminal equipped with a VOX function for example, when voice is collected by a microphone, a transmission right is acquired, and when the voice is interrupted, the transmission right is released.
  • the communication terminal having the VOX function it is possible to broadcast the voice data to another communication terminal without the user pressing the button for calling.
  • a communication terminal equipped with a VOX function has the advantage of being able to transmit voice data in a hands-free manner, but has some problems. For example, since the transmission right is acquired after detecting the voice, the call may be cut off. In addition, there is a possibility that a conversation that is not desired to be transmitted is transmitted, and that a conversation is started due to external noise.
  • the purpose is communication in one-to-many group simultaneous communication, in which communication is possible without the user operating a button for communication, and it is possible to prevent a break in communication and an unintended start of communication.
  • the communication method according to the present invention is carried out by a communication terminal that carries out one-to-many communication between a plurality of communication terminals belonging to a group associated with the plurality of communication terminals.
  • the communication method includes a step of driving an imaging unit of the communication terminal, a step of requesting a transmission right for the one-to-many communication when a user of the communication terminal is photographed by the imaging unit, and the above.
  • the transmission right is granted, it includes a step of accepting input of information.
  • the communication terminal is any communication terminal among a plurality of communication terminals belonging to a group associated with the plurality of communication terminals.
  • the communication terminal includes an imaging unit, a transmission right requesting unit, and a communication control unit.
  • the transmission right requesting unit requests a transmission right for one-to-many communication.
  • the communication control unit accepts the input of information and carries out one-to-many communication between the plurality of communication terminals.
  • the communication terminal in one-to-many group simultaneous communication, communication is possible without the user operating a button for communication, and the communication is cut off and the communication is cut off. It is possible to prevent the start of unintended communication.
  • FIG. 1 is a block diagram showing a functional configuration of the communication system according to the first embodiment.
  • FIG. 2 is a block diagram showing a functional configuration of the communication terminal shown in FIG.
  • FIG. 3 is a flowchart showing an operation when the processing unit registers the setting of the communication procedure in the communication terminal shown in FIG.
  • FIG. 4 is a diagram illustrating the operation of the processing server and the communication terminal when voice communication is performed in the communication system shown in FIG.
  • FIG. 5 is a diagram showing an adjustment example of the imaging unit shown in FIG.
  • FIG. 6 is a diagram illustrating the operation of the processing server and the communication terminal when the transmission right is released in the communication system shown in FIG.
  • FIG. 7 is a diagram showing changes in an image captured by the imaging unit shown in FIG. FIG.
  • FIG. 8 is a block diagram showing a functional configuration of the communication terminal according to the second embodiment.
  • FIG. 9 is a diagram illustrating the operation of the processing server and the communication terminal when the communication terminal shown in FIG. 8 acquires the transmission right.
  • FIG. 10 is a diagram showing the operation of the user.
  • FIG. 11 is a diagram illustrating an example of the operation of the processing server and the communication terminal when the communication terminal shown in FIG. 8 releases the transmission right.
  • FIG. 1 is a block diagram showing an example of a functional configuration of the communication system 1 according to the present embodiment.
  • the communication system 1 shown in FIG. 1 uses, for example, PoC (Push-to-Talk over Cellular) to realize one-to-many voice communication in group units.
  • the communication system 1 shown in FIG. 1 includes, for example, a processing server 10, communication terminals 20-1 to 20-m, and base stations 30-1 to 30-n.
  • the processing server 10 and the base stations 30-1 to 30-n are connected via the Internet and a network such as a communication network provided by a telecommunications carrier.
  • the communication terminals 20-1 to 20-m wirelessly connect to the base stations 30-1 to 30-n that form a wireless area including the currently existing positions.
  • the processing server 10 is, for example, a plurality of users who participate in the same talk group as the source user by using the voice data transmitted from the communication terminal having the transmission right among the communication terminals 20-1 to 20-m. It is a signal processing device that performs control for broadcasting to a communication terminal owned by the company.
  • the transmission right means the right to transmit voice data in PoC.
  • the processing server 10 registers users who participate in a talk group that carries out one-to-many voice communication. Specifically, for example, the processing server 10 acquires user information which is information about users who participate in a predetermined talk group based on a request from communication terminals 20-1 to 20-m. The processing server 10 stores the acquired user information in association with the participating talk group.
  • the user information includes, for example, the ID of the talk group, the ID of the user who participates in the talk group, the IP address of the communication terminal owned by the user, the language code for the language set by the user, and the login status of the user. , And the location information of the communication terminal owned by the user.
  • the processing server 10 gives the transmission right to any of the communication terminals possessed by the users participating in the predetermined talk group.
  • the processing server 10 controls communication between communication terminals possessed by users participating in the talk group so that one-to-many voice communication is realized. Specifically, for example, the processing server 10 transmits the voice data transmitted from the communication terminal to which the transmission right is given to the communication terminal possessed by the users participating in the same talk group.
  • Base stations 30-1 to 30-n are provided for each area of a predetermined size to form a predetermined wireless area.
  • the base stations 30-1 to 30-n wirelessly connect to the communication terminals 20-1 to 20-m existing in the wireless area formed by the own device.
  • Communication terminals 20-1 to 20-m are terminals owned by the user, such as mobile phones, smartphones, tablet PCs, and predetermined dedicated terminals.
  • the communication terminals 20-1 to 20-m carry out one-to-many voice communication using PoC via the processing server 10.
  • the communication terminals 20-1 to 20-m participate in the talk group according to the operation from the user. Any of the communication terminals 20-1 to 20-m acquires the transmission right according to the operation from the user.
  • the operation from the user is, for example, pressing a button or photographing a person with an imaging unit such as a camera.
  • the communication terminal that has acquired the transmission right receives the voice input from the user, and transmits the voice data based on the received voice to other communication terminals participating in the same talk group via the processing server 10. Further, the communication terminals 20-1 to 20-m receive the voice data transmitted from the processing server 10 and reproduce the voice based on the voice data.
  • FIG. 2 is a block diagram showing an example of the functional configuration of the communication terminal 20 shown in FIG.
  • the communication terminal 20 shown in FIG. 2 includes, for example, a processing unit 21, a storage unit 22, an input interface 23, an output interface 24, a communication interface 25, a GPS receiver 26, and an imaging unit 27. Since the configurations of the communication terminals 20-1 to 20-m are the same, the communication terminal 20 will be described in the description of FIG.
  • the processing unit 21 includes, for example, a CPU and a volatile memory such as a RAM (Random Access Memory), which is a main storage device used when the CPU executes processing.
  • a CPU reads the application program stored in the storage unit 22 into the RAM.
  • the CPU executes the application program read into the RAM.
  • the processing unit 21 realizes various functions corresponding to the application program.
  • the storage unit 22 is a so-called auxiliary storage device including a non-volatile storage circuit such as a NAND type or NOR type flash memory.
  • the storage unit 22 may be a drive device or the like that reads and writes various information between the SD card and a portable storage medium such as a micro SD card.
  • the storage unit 22 stores the application program according to the present embodiment.
  • the storage unit 22 stores information about a talk group in which the own terminal can participate.
  • the storage unit 22 stores information about the registered image.
  • the input interface 23 is realized by, for example, a button, a touch panel for inputting instructions by touching the operation surface, a microphone for inputting voice, and the like.
  • the input interface 23 converts an input instruction from the operator into an electric signal, and outputs the electric signal to the processing unit 21.
  • the output interface 24 is realized by, for example, a display device and a speaker.
  • the display device include a liquid crystal display and an organic EL display.
  • the display device displays image data about the display target.
  • the speaker reproduces voice data associated with voice communication.
  • the communication interface 25 is a circuit that wirelessly connects to base stations 30-1 to 30-n.
  • the communication interface 25 is realized by, for example, an antenna and a wireless unit.
  • the antenna receives the incoming radio signal. It also transmits a wireless signal output from the wireless unit.
  • the radio unit converts the radio signal received by the antenna according to a preset demodulation method, and outputs the converted data to the processing unit 21. Further, the wireless unit converts the data created by the processing unit 21 into a wireless signal according to a preset modulation method, and outputs the converted wireless signal to the antenna.
  • the GPS receiver 26 receives a signal transmitted from a GPS satellite and creates position information based on the received signal.
  • the imaging unit 27 is a device that images the real space, and is realized by, for example, a camera or the like.
  • the image pickup unit 27 has, for example, a lens and an image pickup sensor, and generates image data by taking an image of a real space.
  • the imaging unit 27 is provided, for example, at a position where a person who sees the display as the output interface 24 can be photographed.
  • the processing unit 21 shown in FIG. 2 realizes a function corresponding to the application program by executing the application program stored in the storage unit 22.
  • the processing unit 21 executes the application program to execute the registration control unit 211, the transmission right request unit 212, the communication control unit 213, the shooting control unit 214, the release request unit 215, the storage control unit 216, and the display control unit. It realizes 217 functions.
  • the registration control unit 211 registers a reference image. Specifically, for example, the registration control unit 211 stores the image data generated by the user operating the image pickup unit 27 in the storage unit 22 as a registered image.
  • the registered image is, for example, an image of a front view of a user.
  • the transmission right requesting unit 212 requests the transmission right from the processing server 10. Specifically, for example, the transmission right requesting unit 212 requests the transmission right to the processing server 10 when a predetermined image is taken by the user.
  • the predetermined image is, for example, an image that is substantially the same as the registered image.
  • the transmission right requesting unit 212 may request the transmission right to the processing server 10 when the PTT call start request button displayed on the display as the output interface 24 of the communication terminal 20 is pressed by the user. Absent.
  • the transmission right requesting unit 212 may notify the user that the transmission right has been granted. At this time, for example, the transmission right requesting unit 212 notifies the user of "a call can be started" or the like via the speaker. Further, when the transmission right requesting unit 212 fails to certify the user, the transmission right requesting unit 212 may notify the user of the failure. At this time, for example, the transmission right requesting unit 212 notifies the user of "Failed in certification" or the like via the speaker.
  • the communication control unit 213 controls communication with the processing server 10. Specifically, for example, the communication control unit 213 of the communication terminal 20 having the transmission right converts the voice input from the microphone according to a predetermined TCP / IP-based protocol. The communication control unit 213 transmits the converted voice data to the processing server 10 via the network and the base station 30. Further, for example, the communication control unit 213 of the communication terminal 20 which does not have the transmission right receives the voice data transmitted from the processing server 10.
  • the shooting control unit 214 controls the imaging unit 27. Specifically, for example, the photographing control unit 214 controls the imaging unit 27 in accordance with an instruction from the user or when a predetermined condition is satisfied to generate image data.
  • the release request unit 215 requests the processing server 10 to release the transmission right. Specifically, for example, the release requesting unit 215 requests the processing server 10 to release the transmission right when a predetermined image is taken by the user.
  • the predetermined image is, for example, an image that is substantially the same as the registered image.
  • the release request unit 215 may request the release of the transmission right by releasing the finger from the PTT call start request button displayed on the display of the communication terminal 20.
  • the memory control unit 216 controls the memory processing such as various received notifications. Specifically, for example, when various notifications and the like are received, the storage control unit 216 stores various notifications and the like in a volatile memory such as a RAM. Various notifications and the like stored in the volatile memory are volatile when the execution of the application program that executes one-to-many voice communication using PoC is completed and when the power of the communication terminal 20 is turned off. It is erased from the sex memory. This makes it possible to avoid risks such as information leakage.
  • the display control unit 217 controls the display process on the display, which is the output interface 24. Specifically, for example, the display control unit 217 controls the display so as to display various received notifications and the like.
  • FIG. 3 is a flowchart showing an example of an operation when the processing unit 21 registers the setting of the communication procedure in the communication terminal 20-1 shown in FIG. If the communication procedure settings have already been registered, the process shown in FIG. 3 may not be executed.
  • the user of the communication terminal 20-1 operates the communication terminal 20-1 and launches an application program that executes one-to-many voice communication using PoC (step S31).
  • the registration control unit 211 of the communication terminal 20-1 displays a selection screen for selecting the setting of the communication procedure on the display which is the output interface 24 (step S32). On this selection screen, for example, the first communication procedure and the second communication procedure can be selected.
  • the first communication procedure is, for example, a communication procedure in which a transmission right is acquired by taking a predetermined image for a user, and the acquired transmission right is released by taking a predetermined image for a user. .. Further, in the second communication procedure, for example, the transmission right is acquired by pressing the PTT call start request button displayed on the display, and the transmission right is released by releasing the PTT communication start request button. It is a procedure. In the present embodiment, the user selects, for example, the first communication procedure.
  • the registration control unit 211 of the communication terminal 20-1 displays a registration screen for registering the registered image on the display (step S34).
  • the shooting control unit 214 of the communication terminal 20 activates the imaging unit 27 (step S35) to start shooting.
  • the registration control unit 211 displays the shooting range by the imaging unit 27 on the registration screen.
  • how to take an image for which registration is recommended may be displayed on the registration screen. For example, on the registration screen, an appropriate method of taking an image such as a front image or a side image as a registered image is instructed.
  • the user operates the input interface 23 and captures a still image by the imaging unit 27.
  • the registration control unit 211 displays, for example, a registration button on the registration screen. If the captured still image is an image suitable for registration, the user presses the registration button displayed on the display (step S36), and stores the captured still image as a registered image in the storage unit 22 (step S37). ).
  • FIG. 4 is a diagram illustrating an example of the operation of the processing server 10 and the communication terminals 20-1 to 20-3 when voice communication is performed in the communication system 1 shown in FIG.
  • information about the talk group G1 is stored in the storage units 22 of the communication terminals 20-1 to 20-3. That is, the communication terminals 20-1 to 20-3 are in a state where they can participate in the talk group G1.
  • the users of the communication terminals 20-1 to 20-3 operate the communication terminals 20-1 to 20-3 to launch an application program that executes one-to-many voice communication using PoC (step S41). ).
  • the display control unit 217 of the communication terminals 20-1 to 20-3 displays, for example, the talk group G1 as a selectable talk group on the display which is the output interface 24 (step S42).
  • a plurality of talk groups that can participate may be displayed on the display.
  • the user of the communication terminals 20-1 to 20-3 selects, for example, the talk group G1 displayed on the display (step S43). It should be noted that the processing unit 21 of the communication terminals 20-1 to 20-3 may automatically select the talk group G1 to participate in based on the participation frequency, the user's setting, and the like. When the talk group G1 is selected, the processing unit 21 of the communication terminals 20-1 to 20-3 causes the GPS receiver 26 to create the position information when the talk group is selected.
  • the communication control units 213 of the communication terminals 20-1 to 20-3 have an ID of the selected talk group (hereinafter referred to as a talk group ID) and an ID set in the own terminal (hereinafter referred to as a talk group ID).
  • a talk group ID an ID of the selected talk group
  • a talk group ID an ID set in the own terminal
  • information data including the user ID) and the acquired position information and the like are created.
  • the information data has, for example, a packet structure.
  • the communication terminals 20-1 and 20-2 transmit the created information data to the processing server 10 via, for example, the base station 30-1 and the network NW (step S44). Further, the communication terminal 20-3 transmits the created information data to the processing server 10 via, for example, the base station 30-2 and the network NW (step S44).
  • the processing server 10 stores the users who participate in the talk group in association with the participating talk groups based on the information data transmitted from the communication terminals 20-1 to 20-3 (step S45).
  • the processing server 10 does not necessarily have to acquire the location information of the communication terminals 20-1 to 20-3. At this time, the communication terminals 20-1 to 20-3 do not have to create the position information. Further, the information data transmitted from the communication terminals 20-1 to 20-3 to the processing server 10 may not include the location information.
  • the transmission right requesting unit 212 of the communication terminals 20-1 to 20-3 displays a standby screen on the display (step S46).
  • the shooting control unit 214 of the communication terminals 20-1 to 20-3 activates the imaging unit 27 (step S47) to start shooting.
  • the transmission right requesting unit 212 displays, for example, a shooting range shot by the imaging unit 27 on the standby screen.
  • the transmission right requesting unit 212 requests the user's authorization prior to the transmission right request. Therefore, the transmission right requesting unit 212 may display, for example, on the standby screen that user authorization is required to acquire the transmission right.
  • the transmission right requesting unit 212 displays, for example, the description "Please certify the user" on the standby screen.
  • a user requesting an utterance for example, a user of the communication terminal 20-1, orients the communication terminal 20-1 on the standby screen so that the front image of the user is included in the shooting range as shown in FIG. Adjust to.
  • the shooting control unit 214 of the communication terminal 20-1 captures a still image of the shooting range at this time. (Step S48).
  • the imaging control unit 214 may capture a still image by operating the input interface 23 by the user.
  • the transmission right requesting unit 212 of the communication terminal 20-1 reads the registered image from the storage unit 22.
  • the transmission right requesting unit 212 collates the still image with the read registered image (step S49), and determines whether or not the person included in the still image matches the person included in the registered image. Matching between the person included in the still image and the person included in the registered image is performed using, for example, a known face recognition algorithm. The matching between the person included in the still image and the person included in the registered image may be executed by using a machine learning model.
  • the image acquired by the transmission right requesting unit 212 is not limited to the still image.
  • the transmission right requesting unit 212 may monitor the image captured by the imaging unit 27 and determine whether or not the captured image includes the same person as the person included in the registered image.
  • the transmission right requesting unit 212 determines that the current user is a registered user (step S410).
  • the communication terminal 20-1 is in the utterance permitted state.
  • the transmission right requesting unit 212 notifies the user, for example, "Certification failed" or the like via a speaker. The transmission right requesting unit 212 does not recognize the current user as a registered user and does not allow the transition to the next step.
  • the transmission right requesting unit 212 may determine whether or not the captured image includes the face facing the person. Matching whether the shape contained in the image being captured is a person's face is performed, for example, using a known certification algorithm.
  • the shooting control unit 214 of the communication terminal 20-1 maintains the shooting by the imaging unit 27 in the utterance permitted state.
  • the transmission right requesting unit 212 certifies the user in step S410
  • the transmission right requesting unit 212 requests the transmission right from the processing server 10.
  • the transmission right requesting unit 212 attaches a user ID to a transmission right acquisition request notification requesting the processing server 10 to acquire the transmission right via, for example, the base station 30-1 and the network NW. (Step S411).
  • Step S412 When the processing server 10 receives the transmission right acquisition request notification from the communication terminal 20-1 in a state where the transmission right is not granted to any of the terminals of the talk group G1, the processing server 10 grants the transmission right to the communication terminal 20-1. (Step S412).
  • the transmission right requesting unit 212 of the communication terminal 20-1 may notify the user that the transmission right has been granted or that the call can be started. .. At this time, for example, the transmission right requesting unit 212 notifies the user of "a call can be started" or the like via the speaker.
  • the communication control unit 213 of the communication terminal 20-1 creates voice data based on the voice input from the microphone (step S414).
  • the voice data has, for example, a packet structure based on a TCP / IP-based proprietary protocol.
  • the communication terminal 20-1 transmits the created voice data to the processing server 10 via, for example, the base station 30-1 and the network NW (step S415).
  • the processing server 10 When the processing server 10 receives the voice data transmitted from the communication terminal 20-1 having the transmission right, the processing server 10 controls to transfer the voice data to the communication terminals 20-2 and 20-3 participating in the talk group G1. It is carried out (step S416). Specifically, for example, when the voice data transmitted from the communication terminal 20-1 is received, the processing server 10 matches the speaker ID stored in the voice data with the user ID to which the transmission right is granted. Judge whether or not. When the speaker ID stored in the voice data and the user ID to which the transmission right is granted match, the processing server 10 duplicates the voice data by the number corresponding to the number of users participating in the talk group G1. To do. The processing server 10 transmits the duplicated voice data by referring to the IP addresses of the communication terminals 20-2 and 20-3 (step S417).
  • the communication control unit 213 of the communication terminals 20-2 and 20-3 receives the voice data transmitted from the processing server 10, the received voice data is reproduced and output as voice from the speaker (step S418). As a result, a PTT call, that is, a PoC communication is established.
  • FIG. 6 is a diagram illustrating an example of the operation of the processing server 10 and the communication terminals 20-1 to 20-3 when the transmission right is released in the communication system 1 shown in FIG. In the description of FIG. 6, PoC communication is established between the communication terminals 20-1 to 20-3.
  • the shooting control unit 214 of the communication terminal 20-1 maintains the shooting by the imaging unit 27.
  • the release requesting unit 215 monitors changes to the image used in the collation in step S49. Specifically, the difference between the image acquired in frame units and the image used in the collation in step S49 is acquired, and whether or not the difference value exceeds a preset range is monitored.
  • the release request unit 215 detects a change in the image (step S61)
  • the release request unit 215 requests the release of the transmission right.
  • the release request unit 215 transmits a transmission right release request notification requesting the release of the transmission right to the processing server 10 via the base station 30-1 and the network NW (step S62).
  • FIG. 7 is a diagram showing an example of a change in the photographing range taken by the imaging unit 27 and displayed on the display as the output interface 24.
  • the user changes the orientation of the communication terminal 20-1 so that a side image as shown in the right figure of FIG. 7 is taken from a front image as shown in the left figure of FIG. 7.
  • the user may, for example, return the communication terminal 20-1 to the holder provided at the treatment position so that the image of the user is out of the shooting range.
  • the processing server 10 Upon receiving the transmission right release request notification, the processing server 10 releases the transmission right of the communication terminal 20-1 (step S63).
  • the communication terminal 20 when the communication terminal 20 authenticates the user using the image captured by the image pickup unit 27, the communication terminal 20 requests the processing server 10 for the transmission right.
  • the processing server 10 for the transmission right.
  • the communication terminal 20 when the communication terminal 20 detects a change from the image collated by the image pickup unit 27 during one-to-many communication, it requests the release of the transmission right. As a result, the transmission right can be released without the user performing an input operation on the communication terminal 20.
  • the communication terminal 20 when the transmission right is granted, notifies the user that the transmission right has been granted or that a call can be made. As a result, the user can recognize that the communication has been started.
  • the imaging unit 27 may acquire an image and transmit the image data of the acquired image to the processing server 10.
  • the release request unit 215 processes the transmission right release request notification by the processing server 10.
  • An example of sending to is explained. However, it is not limited to this.
  • the release request unit 215 may transmit a transmission right release request notification based on the voice detection result. Specifically, for example, the release request unit 215 may transmit a transmission right release request notification to the processing server 10 when a predetermined period has elapsed since no voice is input to the microphone.
  • FIG. 8 is a block diagram showing an example of the functional configuration of the communication terminal 20a according to the second embodiment.
  • the storage unit 22a shown in FIG. 8 is a so-called auxiliary storage device including a non-volatile storage circuit such as a NAND type or NOR type flash memory.
  • the storage unit 22a may be a drive device or the like that reads and writes various information between the SD card and a portable storage medium such as a micro SD card.
  • the storage unit 22a stores the application program according to the present embodiment.
  • the storage unit 22a stores information about a talk group in which the terminal can participate.
  • the storage unit 22a stores information about the image condition that triggers the request for the transmission right.
  • the image condition that triggers the request for the transmission right includes, for example, a condition for detecting a predetermined part of the human body.
  • the conditions for detecting a predetermined part of the human body include, for example, the conditions for detecting the human temporal region.
  • the conditions for detecting the human temporal region include information on, for example, the shape and position of parts such as the face and head that constitute the temporal region, such as the nose, eyes, mouth, ears, forehead, and occipital region. Including.
  • the image condition also includes the size of the object to be photographed occupied on the screen.
  • the conditions for detecting a predetermined part of the human body may include a condition for detecting a human face.
  • the processing unit 21a shown in FIG. 8 realizes a function corresponding to the application program by executing the application program stored in the storage unit 22a.
  • the processing unit 21a realizes the functions of the transmission right requesting unit 212a, the communication control unit 213, the photographing control unit 214, the opening requesting unit 215a, the storage control unit 216, and the display control unit 217 by executing the application program. To do.
  • the transmission right request unit 212a requests the transmission right from the processing server 10. Specifically, for example, the transmission right requesting unit 212a requests the processing server 10 for the transmission right when a predetermined image is taken by the user.
  • the predetermined image is, for example, an image that satisfies the conditions stored in the storage unit 22a.
  • the transmission right requesting unit 212a may notify the user that the transmission right has been granted. At this time, for example, the transmission right requesting unit 212a notifies the user of "a call can be started” or the like via the speaker. Further, when the captured image does not satisfy the condition, the transmission right requesting unit 212a may notify the user that the condition is not satisfied. At this time, for example, the transmission right requesting unit 212a notifies the user of "the call cannot be started” or the like via the speaker.
  • the release request unit 215a requests the processing server 10 to release the transmission right. Specifically, for example, the release request unit 215a requests the processing server 10 to release the transmission right when a predetermined image is taken by the user.
  • the predetermined image is, for example, an image that satisfies the conditions stored in the storage unit 22a.
  • the processing unit 21a may further have a registration control unit for registering the image condition in the storage unit 22a.
  • FIG. 9 is a diagram illustrating an example of the operation of the processing server 10 and the communication terminals 20a-1 to 20a-3 when the communication terminal 20a-1 shown in FIG. 8 acquires a transmission right. Note that FIG. 9 shows an operation after the information of the users participating in the talk group is stored in the processing server 10, that is, an operation after step S45 in FIG.
  • the transmission right requesting unit 212a of the communication terminals 20a-1 to 20a-3 displays the standby screen on the display (step S91).
  • the shooting control unit 214 of the communication terminals 20a-1 to 20a-3 activates the imaging unit 27 (step S92) to start shooting.
  • the transmission right requesting unit 212a displays, for example, the shooting range shot by the imaging unit 27 on the standby screen.
  • the users of the communication terminals 20a-1 to 20a-3 have the communication terminals 20a-1 to 20a-3, for example, the surface on the display side near the upper arm so that both hands can be freed even when speaking. It is installed so that it faces the space.
  • the communication terminals 20a-1 to 20a-3 may be mounted near the forearm.
  • a user requesting a transmission right for example, a user of the communication terminal 20a-1, tilts his head, brings his upper arm closer to his face, and wears the communication terminal 20a-1 near his upper arm. Close to the temporal region.
  • the imaging unit 27 of the communication terminal 20a-1 photographs the temporal region of the user (step S93). The user returns to the original posture when the temporal region is photographed.
  • the transmission right requesting unit 212a of the communication terminal 20a-1 monitors the image captured by the imaging unit 27.
  • the transmission right requesting unit 212a detects the temporal region of the user from the image acquired in frame units, for example, based on the image conditions stored in the storage unit 22a (step S94).
  • an existing detection algorithm is used for the detection. For example, when the user's temporal region is photographed in the posture shown in FIG. 10, the enlarged temporal region is photographed. Therefore, the size of the photographed temporal region may also be a requirement for detecting the temporal region. This makes it possible to suppress the detection of the temporal region of another person who is not the user.
  • the transmission right request unit 212a When the transmission right request unit 212a detects the temporal region of the user, the transmission right acquisition request notification is transmitted to the processing server 10 with the user ID via, for example, the base station 30-1 and the network NW. (Step S95). If the captured object does not meet the conditions, that is, if the captured object is not detected as the user's temporal region, the transmission right requesting unit 212a may display the captured object. The user may be notified that the conditions are not met or that the call cannot be started. At this time, for example, the transmission right requesting unit 212a notifies the user of "the call cannot be started" or the like via the speaker.
  • Step S96 When the processing server 10 receives the transmission right acquisition request notification from the communication terminal 20a-1 in a state where the transmission right is not granted to any of the terminals of the talk group G1, the processing server 10 grants the transmission right to the communication terminal 20a-1. (Step S96).
  • the transmission right requesting unit 212a of the communication terminal 20a-1 may notify the user that the transmission right has been granted or that the call can be started. .. At this time, for example, the transmission right requesting unit 212a notifies the user of "a call can be started" or the like via the speaker.
  • FIG. 11 is a diagram illustrating an example of the operation of the processing server 10 and the communication terminal 20a-1 when the communication terminal 20a-1 shown in FIG. 8 releases the transmission right.
  • PoC communication is established between the communication terminals 20a-1 to 20a-3.
  • the user of the communication terminal 20a-1 having the transmission right terminates the PoC communication, for example, as shown in FIG. 10, the user tilts his head, brings his upper arm closer to his face, and wears the communication terminal near his upper arm. Bring 20a-1 closer to the temporal region.
  • the image pickup unit 27 of the communication terminal 20a-1 photographs the temporal region of the user. The user returns to the original posture when the temporal region is photographed.
  • the shooting control unit 214 of the communication terminal 20a-1 maintains the shooting by the imaging unit 27.
  • the opening request unit 215a of the communication terminal 20a-1 monitors the image captured by the imaging unit 27.
  • the release requesting unit 215a detects the temporal region of the user from the image acquired in frame units based on the image conditions stored in the storage unit 22a, for example (step S111). For the detection, for example, an existing detection algorithm is used.
  • the release request unit 215a When the release request unit 215a detects the temporal region of the user, it transmits a transmission right release request notification to the processing server 10 via, for example, the base station 30-1 and the network NW (step S112).
  • the processing server 10 When the processing server 10 receives the transmission right release request notification, the processing server 10 releases the transmission right of the communication terminal 20a-1 (step S113).
  • the communication terminal 20a requests the processing server 10 for the transmission right when the user is photographed by the imaging unit 27.
  • the processing server 10 requests the processing server 10 for the transmission right when the user is photographed by the imaging unit 27.
  • the communication terminal 20a requests the processing server 10 for the transmission right when a predetermined part of the human body is detected in the captured image. This makes it possible to improve the accuracy of utterance.
  • the communication terminal 20a when the predetermined part of the human body is not detected in the captured image, the communication terminal 20a notifies the user that it is not detected or that communication is not possible. There is. This makes it possible for the user to notice that PoC communication has not been established.
  • the communication terminal 20a requests the release of the transmission right when a predetermined portion is detected in the image captured by the image pickup unit 27 during the one-to-many communication. ing. As a result, the transmission right can be released without the user performing an input operation on the communication terminal 20a.
  • the communication terminal 20a when the transmission right is granted, notifies the user that the transmission right has been granted or that a call can be made. As a result, the user can recognize that the communication has been started.
  • the release request unit 215a when the user, for example, the temporal region is detected in the image taken during the utterance, the release request unit 215a transmits the transmission right release request notification to the processing server 10.
  • the release request unit 215a may transmit a transmission right release request notification based on the voice detection result.
  • the release request unit 215a may transmit a transmission right release request notification to the processing server 10 when a predetermined period has elapsed since no voice is input to the microphone.
  • the communication terminal 20 does not necessarily have to be carried by the user.
  • the communication terminal 20 may be fixed by a holder or the like in a place where it can be fixed, such as on a desk.
  • the conditions for detecting a predetermined part of the human body may include, for example, the conditions for detecting the upper body or the whole body. Since the user does not necessarily have to carry the communication terminal, it is possible to realize one-to-many group simultaneous communication even when it is prohibited to touch the device for hygiene reasons.
  • the communication terminals 20 and 20a can communicate in one-to-many group simultaneous communication without the user operating the communication button, and the communication is cut off. , And unintentional start of communication can be prevented.
  • the present invention is not limited to the above embodiment, and can be variously modified at the implementation stage without departing from the gist thereof.
  • each embodiment may be carried out in combination as appropriate, in which case the combined effect can be obtained.
  • the above-described embodiment includes various inventions, and various inventions can be extracted by a combination selected from a plurality of disclosed constituent requirements. For example, even if some constituent requirements are deleted from all the constituent requirements shown in the embodiment, if the problem can be solved and the effect is obtained, the configuration in which the constituent requirements are deleted can be extracted as an invention.
  • Communication system 10 ... Processing server 20, 20-1 to 20-3, 20-m ... Communication terminals 20a, 20a-1 to 20a-3 ... Communication terminals 21,21a ... Processing units 22, 22a ... Storage unit 23 ... Input interface 24 ... Output interface 25 ... Communication interface 26 ... GPS receiver 27 ... Imaging unit 30, 30-1 to 30-n ... Base station 211 ... Registration control unit 212, 212a ... Transmission right request unit 213 ... Communication control unit 214 ... Shooting control unit 215, 215a ... Opening request unit 216 ... Storage control unit 217 ... Display control unit

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Telephonic Communication Services (AREA)

Abstract

La présente invention concerne un procédé de communication qui est mis en œuvre par un terminal de communication effectuant des communications de un à plusieurs parmi une pluralité de terminaux de communication appartenant à un groupe associé à la pluralité de terminaux de communication. Le procédé de communication comprend les étapes consistant à : piloter une unité de capture d'image du terminal de communication; demander un droit de transmission pour les communications de un à plusieurs lorsque l'image d'un utilisateur du terminal de communication est capturée par l'unité de capture d'image; et accepter une entrée d'informations lorsque le droit de transmission est octroyé.
PCT/JP2019/033557 2019-08-27 2019-08-27 Terminal de communication, procédé de communication, et programme de communication WO2021038725A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/JP2019/033557 WO2021038725A1 (fr) 2019-08-27 2019-08-27 Terminal de communication, procédé de communication, et programme de communication
JP2021541845A JPWO2021038725A1 (fr) 2019-08-27 2019-08-27

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/033557 WO2021038725A1 (fr) 2019-08-27 2019-08-27 Terminal de communication, procédé de communication, et programme de communication

Publications (1)

Publication Number Publication Date
WO2021038725A1 true WO2021038725A1 (fr) 2021-03-04

Family

ID=74684660

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/033557 WO2021038725A1 (fr) 2019-08-27 2019-08-27 Terminal de communication, procédé de communication, et programme de communication

Country Status (2)

Country Link
JP (1) JPWO2021038725A1 (fr)
WO (1) WO2021038725A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002077842A (ja) * 2000-08-31 2002-03-15 Sumitomo Electric Ind Ltd 双方向対話型通信システムの端末装置
JP2003101663A (ja) * 2001-09-21 2003-04-04 Sharp Corp 画像通信端末装置
JP2006074496A (ja) * 2004-09-02 2006-03-16 Fujitsu Ltd 同報通話システムにおける通信帯域制御方法、同報通話システムに用いられるサーバ装置および利用者端末、プログラム
JP2007266992A (ja) * 2006-03-28 2007-10-11 Kyocera Corp サーバー及び無線通信端末
JP2014520421A (ja) * 2011-05-12 2014-08-21 クアルコム，インコーポレイテッド ワイヤレス通信デバイス上のグループ通信セッション用のジェスチャーベースのコマンド
US9049983B1 (en) * 2011-04-08 2015-06-09 Amazon Technologies, Inc. Ear recognition as device input
CN105430322A (zh) * 2016-01-22 2016-03-23 深圳市华玺科技有限公司 一种无人机接入视频会议方法及***

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002077842A (ja) * 2000-08-31 2002-03-15 Sumitomo Electric Ind Ltd 双方向対話型通信システムの端末装置
JP2003101663A (ja) * 2001-09-21 2003-04-04 Sharp Corp 画像通信端末装置
JP2006074496A (ja) * 2004-09-02 2006-03-16 Fujitsu Ltd 同報通話システムにおける通信帯域制御方法、同報通話システムに用いられるサーバ装置および利用者端末、プログラム
JP2007266992A (ja) * 2006-03-28 2007-10-11 Kyocera Corp サーバー及び無線通信端末
US9049983B1 (en) * 2011-04-08 2015-06-09 Amazon Technologies, Inc. Ear recognition as device input
JP2014520421A (ja) * 2011-05-12 2014-08-21 クアルコム，インコーポレイテッド ワイヤレス通信デバイス上のグループ通信セッション用のジェスチャーベースのコマンド
CN105430322A (zh) * 2016-01-22 2016-03-23 深圳市华玺科技有限公司 一种无人机接入视频会议方法及***

Also Published As

Publication number Publication date
JPWO2021038725A1 (fr) 2021-03-04

Similar Documents

Publication Publication Date Title
JP6353603B2 (ja) スマートホームデバイスの制御方法、装置、電子デバイス、プログラム及び記憶媒体
EP3133851B1 (fr) Procédé et dispositif pour acquisition au moyen d'autorité
EP3041280A1 (fr) Procédé et appareil de liaison d'un dispositif intelligent
JP6423129B1 (ja) スマートデバイス制御方法および装置
CN108989322B (zh) 数据传输方法、移动终端及计算机可读存储介质
EP3223147A2 (fr) Procédé d'accès à un ordinateur virtuel et terminal mobile
CN107147656B (zh) 远程控制的建立方法、***及可读存储介质
US20160191266A1 (en) Method and apparatus for binding intelligent device
CN210112145U (zh) 音视频会议***及设备
CN107566734B (zh) 人像拍照智能控制方法、终端以及计算机可读存储介质
EP3993364B1 (fr) Procédé de co-hébergement, et dispositif électronique
CN106255071A (zh) 发送求救信息的方法及装置
JP2016539599A (ja) 送信パワー調整方法、送信パワー調整装置、プログラム及び記録媒体
CN106101413A (zh) 终端呼叫方法及装置
WO2020029025A1 (fr) Procédé et dispositif de configuration de trajectoire de vol
CN110784908A (zh) 无线配网方法、无线路由器及无线配网***
JP5993164B2 (ja) 通信機器、通信方法およびプログラム
JP2005117141A (ja) 半二重無線通信装置、システムおよび方法
CN111246401B (zh) 频率变更方法及装置
WO2021038725A1 (fr) Terminal de communication, procédé de communication, et programme de communication
CN106331780B (zh) 授权直播方法、装置、设备及***
US10516849B2 (en) Video call method, apparatus and system
US9479734B2 (en) Information processing apparatus, calling method, and communication system
CN114095616A (zh) 通话实现方法和装置、电子设备、可读存储介质
JP2018037963A (ja) ウェアラブルカメラシステム及び録画制御方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19943155

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021541845

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19943155

Country of ref document: EP

Kind code of ref document: A1