WO2022003872A1 - Information processing system, information processing device, server device, program, or method - Google Patents
Information processing system, information processing device, server device, program, or method Download PDFInfo
- Publication number
- WO2022003872A1 WO2022003872A1 PCT/JP2020/025875 JP2020025875W WO2022003872A1 WO 2022003872 A1 WO2022003872 A1 WO 2022003872A1 JP 2020025875 W JP2020025875 W JP 2020025875W WO 2022003872 A1 WO2022003872 A1 WO 2022003872A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- user
- terminal device
- information
- image
- program
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/10—Office automation; Time management
Definitions
- the technology disclosed in this application relates to an information processing system, an information processing device, a server device, a program, or a method.
- various embodiments of the present invention provide an information processing system, an information processing apparatus, a server apparatus, a program, or a method in order to solve the above-mentioned problems.
- the system according to the first embodiment of the present application is A program that can be executed on the WEB browser of the first terminal device to the first terminal device related to the first user can be transmitted to the first transmission unit.
- User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device.
- the acquisition unit that can acquire information including A second transmission unit capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device, and It is a system equipped with
- the user attribute information includes information indicating the presence or absence of the first user in the image. system.
- the system according to the second embodiment of the present application is the system according to the first embodiment.
- the machine-learned function in the program is machine-learned about the relationship between the image and the user attribute information, and can generate the corresponding user attribute information for the image.
- the user attribute information does not include the image related to the first terminal device. system.
- the system according to the third embodiment of the present application is the system according to the first or second embodiment.
- the program does not access the image pickup device according to the first terminal device in which the program is executed for the first predetermined period after receiving the predetermined input to acquire the image. system.
- the system according to the fourth embodiment of the present application is the system according to any one of the first to third embodiments.
- the program is an access for acquiring the image to the image pickup device according to the first terminal device in which the program is executed after the elapse of the first predetermined period after receiving the predetermined input. Do regularly, system.
- the system according to the fifth embodiment of the present application is the system according to any one of the first to fourth embodiments.
- the information based on the user attribute information includes a time when it is determined that the first user related to the user attribute information is not continuously included in the image. system.
- the system according to the sixth embodiment of the present application is the system according to any one of the first to fifth embodiments.
- the information based on the user attribute information includes information indicating the situation of the first user. system.
- the system according to the seventh embodiment of the present application is the system according to any one of the first to sixth embodiments.
- the information indicating the situation of the first user is information indicating a situation in which the first user is concentrated, information indicating that the first user is in a meeting, and / or the first use. Including location information, where there is a person, system.
- the program according to the eighth embodiment of the present application is The system, A first transmission means capable of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device according to the first user.
- User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device.
- Information that can be obtained including
- the user attribute information includes information indicating the presence or absence of the first user in the image. program.
- the program according to the ninth embodiment of the present application is the program according to the eighth embodiment.
- the method according to the tenth embodiment of the present application is the system, A first transmission step of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device according to the first user.
- User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device.
- Get the information, including the get step A second transmission step of transmitting information based on the user attribute information to a second terminal device different from the first terminal device.
- the user attribute information includes information indicating the presence or absence of the first user in the image.
- the method according to the eleventh embodiment of the present application is the method according to the tenth embodiment.
- the apparatus is The first acquisition unit, which can acquire a program that can be executed on the WEB browser of the first terminal device, User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device.
- a transmitter that can send information including An acquisition unit that can acquire information based on user attribute information related to a second terminal device different from the first terminal device. It is a first terminal device provided with The user attribute information includes information indicating the presence or absence of the first user in the image. First terminal device.
- the apparatus according to the thirteenth embodiment of the present application is the apparatus according to the twelfth embodiment.
- a first terminal device executed by an arithmetic unit in the first terminal device.
- the program according to the 14th embodiment of the present application is The first terminal device, An acquisition means for acquiring an image captured by an image pickup device according to the first terminal device, A transmission means for transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device. An acquisition means for acquiring information based on user attribute information related to a second terminal device different from the first terminal device. A program that can be executed on the WEB browser of the first terminal device and has the machine-learned function.
- the user attribute information includes information indicating the presence or absence of the first user in the image. program.
- the program according to the fifteenth embodiment of the present application is the program according to the fourteenth embodiment.
- the method according to the 16th embodiment of the present application is The first terminal device that has machine-learned functions and can be executed on the WEB browser is Acquisition step of acquiring an image captured by the image pickup device according to the first terminal device, A transmission step of transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device. An acquisition step of acquiring information based on user attribute information related to a second terminal device different from the first terminal device. Is a way to do The user attribute information includes information indicating the presence or absence of the first user in the image. Method.
- the method according to the 17th embodiment of the present application is the method according to the 16th embodiment.
- opportunities for communication can be increased more appropriately.
- FIG. 1 is a block diagram showing an overall configuration of one system according to one embodiment.
- FIG. 2 is a block diagram showing a function of one system according to one embodiment.
- FIG. 3 is an example of data included in one system according to one embodiment.
- FIG. 4 is an example of data included in one system according to one embodiment.
- FIG. 5 is an example of a screen displayed by one system according to one embodiment.
- FIG. 6 is an example of a screen displayed by one system according to one embodiment.
- FIG. 7 is an example of data possessed by one system according to one embodiment.
- FIG. 8 is an example showing the relationship of data possessed by one system according to one embodiment.
- FIG. 9 is an example of a screen displayed by one system according to one embodiment.
- FIG. 10 is an example of the configuration of one system according to one embodiment.
- FIG. 10 is an example of the configuration of one system according to one embodiment.
- FIG. 11 is an example of a flow related to one system according to one embodiment.
- FIG. 12 is an example of a flow related to one system according to one embodiment.
- FIG. 13 is an example of a flow related to one system according to one embodiment.
- FIG. 14 is an example of a flow related to one system according to one embodiment.
- FIG. 15 is an example of a screen according to one system according to one embodiment.
- FIG. 16 is an example of a screen according to one system according to one embodiment.
- FIG. 17 is an example of a screen according to one system according to one embodiment.
- FIG. 18 is an example of a screen according to one system according to one embodiment.
- FIG. 19 is an example of a screen according to one system according to one embodiment.
- FIG. 20 is an example of the configuration of one system according to one embodiment.
- the system of the embodiment according to the present invention communicates the situation of each user who uses the information processing device with each other and promotes the improvement of communication according to the situation under the protection of a certain degree of privacy.
- the term "system" may be composed of one or more information processing devices.
- the system of one embodiment may be one or more terminal devices, one or more management devices, or one or more terminal devices and one or more management devices, which will be described later. It may be a device.
- the system of one embodiment is, for example, FIG.
- the user terminals 011 to 015 and the management devices 001 and 002 may be connected to each other.
- the number of management devices may be one or a plurality.
- the management terminals 001a and 002a may be connected to the management devices 001 and 002, respectively.
- the management device may be connected to one or more management terminals.
- a plurality of terminal devices that acquire images and display information, and a plurality of terminals that acquire information obtained from a plurality of terminal devices, process information, and perform information processing. It may be equipped with a management system for transmitting to the device.
- a management system for transmitting to the device.
- the function on the terminal device side and the function on the management device side will be described separately.
- a person who uses the terminal device is referred to as a "user”
- a person who uses the management device is referred to as an "administrator”.
- An embodiment according to the present invention includes an information generation unit for generating information, an information transmission unit, and an information display unit as functions in the terminal device.
- One embodiment according to the present invention may be software executed in a terminal device. Further, one embodiment according to the present invention may be software executed on a WEB browser in the terminal device, or may be software downloaded to the terminal device and installed in the terminal device.
- the software executed on the above-mentioned WEB browser is software that can be executed in the WEB browser, and the difference between the individual information processing devices is absorbed by the WEB browser installed in each information processing device, and the WEB browser is used. It may be provided as software corresponding only to the type and version of. In this case, there is an advantage that the burden of creating software is much reduced as compared with creating software that can be installed in each information processing device.
- the software of one embodiment according to the present invention may be installed in a terminal device.
- the utilization rate of can be reduced.
- the terminal device may be a portable terminal device such as a notebook personal computer, a tablet PC, a smartphone, a mobile phone, etc. that can be used in business by a user, a desktop personal computer, or the like, as long as it is an information processing device. good.
- the information generation unit has a function of generating information. More specifically, the information generation unit has a function of generating user attribute information from an image.
- the term user attribute information does not include images such as still images and moving images obtained by capturing a user in real time by an image pickup device related to a user terminal.
- the terminal device transmits information based on the user attribute information to the management device, but by not including the image itself related to the real-time user, the real-time privacy of the user who uses the terminal device. Has the advantage of being able to protect.
- there may be "user static attribute information" and "user dynamic attribute information” and the user attribute information generated by the information generation unit is It may be treated as user dynamic attribute information.
- the still image of the user's face and the moving image of the face acquired through the image pickup device are highly private information indicating the person himself / herself more directly than the name and address, and such a face.
- the image obtained through the image pickup device is an image in a person's residence and is an extremely private image. The inventors thought that constant communication through the system would increase the mental burden on people as well as working hours.
- the information generated from the image is generated from the image in order to transmit the information generated from the image from the terminal device to the management device without transmitting the image from the terminal device to the management device. It is configured to execute the function to be performed on the terminal device.
- the image acquisition device associated with the terminal device may be used for the function of acquiring the image possessed by the information generation unit.
- the image pickup device associated with the terminal device may be an image pickup device provided inside the terminal device, or may be an image pickup device connected to the terminal device outside the terminal device.
- the image pickup device may be a WEB camera, a portable terminal camera, or the like, as long as the image can be acquired by the image pickup function.
- the image may be a still image or a moving image, and the term image is used as a term of a superordinate concept of the still image and the moving image.
- the information generation unit may acquire user attribute information from the acquired image.
- the information generation unit may have a machine-learned function in which the relationship between the image and the user attribute information is machine-learned.
- the information generation unit may generate the corresponding image information for the newly captured and acquired image by using the machine-learned function.
- the above-mentioned machine-learned function in the information generation unit may be realized by the function of the machine-learned model.
- the machine-learned model may be a model that can execute a machine-learned function that machine-learns the relationship between the image and the user attribute information, and the corresponding user corresponds to the newly captured image. It may be something that can generate attribute information.
- the machine-learned model may be software that can be executed by using the CPU and the memory in the information processing apparatus.
- the user attribute information may include information indicating the presence or absence of a human face in the captured image.
- the machine-learned function according to one embodiment has machine-learned the relationship between the image and the presence / absence of a person in the image, and information indicating the presence / absence of a person in the image for a new image. May be able to generate.
- the machine-learned function according to the embodiment may generate information indicating that there is a human face in the image only when there is one human face in the image, or the image. If there is one or more human faces inside, information indicating that there is a human face in the image may be generated.
- the information generation unit may issue an alert for looking into the screen when a plurality of human faces are detected in the acquired image. Specifically, when the information generation unit in the program executed on the WEB browser in the first terminal device detects the faces of a plurality of people in the acquired image, the inside of the first terminal device.
- the display generation unit which will be described later in the program executed on the WEB browser of the above, may issue an alert so that the user related to the first terminal device notices the peek at the screen.
- the machine learning unit of the information generation unit in the program executed on the WEB browser in the first terminal device uses the directions of the lines of sight of the faces of a plurality of people in the acquired captured image.
- the display generation unit may issue an alert so that the user related to the first terminal device notices the peek at the screen.
- Such a machine learning unit may be, for example, machine-learned about the relationship between an image and the direction of the line of sight of a person's face, and specifies the direction of the person's line of sight in the image for a new image.
- the machine learning unit may be machine-learned about the relationship between the image and whether or not the direction of the line of sight of the human face is substantially the direction of the screen, and the machine learning unit may be used for a new image.
- whether or not the direction of the screen is substantially the direction of the screen may be the direction of the image pickup device that has captured the image, or the direction of the screen in consideration of the positional deviation between the image pickup device that has captured the image and the screen. There may be.
- the mode of the alert that the user notices may be various.
- the whole or a part of the WEB browser may be expressed as "peeping detection" or "alert".
- the alert may be an expression that cannot be understood by a third party without knowing it, and may be an expression that can be understood only by the user described in the manual of the system according to the present embodiment. In this case, only the user can notice the peeping, and there is an advantage that the user is given an opportunity to casually prevent such peeping.
- such an alert may not only be displayed, or may emit a sound instead of the display. In this case, the sound has the advantage that the user can be more aware of the peeping.
- the information display unit may display such an alert in real time after the information generation unit detects it.
- the fact that such an alert is generated may be transmitted to the management device via the information transmission unit.
- the management device may associate and store such alerts with the user.
- the management device generates statistical information about the total number of alerts generated by each user within a predetermined period, the average number within a predetermined period, etc., sends it to the administrator terminal, and displays it on the administrator terminal. It may be possible.
- the administrator related to the administrator terminal has an advantage that the user can obtain information on how much he / she is looking into and have an opportunity to give advice on the user's working environment. ..
- the user attribute information may include information indicating the presence or absence of a user's face that has been authenticated by using the information related to the user's face registered in advance in the captured image.
- the machine-learned function according to the embodiment has machine-learned the relationship between the image and the information indicating the face of the person in the image, and the face of the person in the image is obtained with respect to the new image.
- the information generation unit determines whether the information indicating the face of the person is the face of the pre-registered user, so that the presence or absence of the face of the pre-registered user is present. May be generated.
- the machine-learned function according to the embodiment is a relationship between an image and information indicating the presence or absence of a pre-registered user's face in the image. Has been machine-learned, and information indicating the presence or absence of a user's face registered in advance in the image may be generated for a new image.
- the machine-learned function according to the embodiment may generate information indicating that there is no user's face whenever there is no user's face in the image, or may be used in the image. Information indicating that there is no user's face may be generated only when there is no person's face and there is no other person's face.
- Information about the pre-registered user's face used for authentication is stored in a cache in a terminal device in which a program executed on the WEB browser can be used, and is pre-registered in the cache in the terminal device.
- the face of the user and the face of the person in the captured image may be collated.
- the feature information that can uniquely identify the user's face used for authentication is transmitted from the terminal device to the management device, and the user's ID or the like is transmitted to the management device.
- the feature information for the human face in the captured image may be transmitted from the terminal device to the management device and collated in the management device.
- the authentication can be performed in the same manner.
- the information generation unit may issue an alert for looking into the screen when a face different from the face of the user registered in advance is detected in the acquired image.
- the information generation unit in the program executed on the WEB browser in the first terminal device detects a face different from the user's face registered in advance in the acquired image
- the display generation unit described later in the program executed on the WEB browser in the first terminal device may issue an alert so that the user related to the first terminal device notices the screen peeping.
- the machine learning unit of the information generation unit in the program executed on the WEB browser in the first terminal device has a line of sight different from the user's face registered in advance in the acquired captured image. Using the direction of, it was detected whether or not the screen was peeped by a face different from the pre-registered user's face, and it was detected that the screen was peeped by a face different from the pre-registered user's face.
- the display generation unit described later in the program executed on the WEB browser in the first terminal device may issue an alert so that the user related to the first terminal device notices the screen peeping.
- the machine learning unit may be machine-learned about the relationship between the image and the direction of the line of sight related to the human face, and may be machine-learned for a new image. It may be able to specify the direction of the line of sight of a person in the image. Further, the machine learning unit may be machine-learned about the relationship between the image and whether or not the direction of the line of sight of the human face is substantially the direction of the screen, and the machine learning unit may be used for a new image. , It may be possible to specify whether or not the direction of the line of sight of a person in the image is substantially the direction of the screen.
- the direction of the screen is substantially the direction of the screen may be the direction of the image pickup device that has captured the image, or the direction of the screen in consideration of the positional deviation between the image pickup device that has captured the image and the screen. There may be.
- the mode of the alert that the user notices may be various.
- the whole or a part of the WEB browser may be expressed as "peeping detection" or "alert".
- the alert may be an expression that cannot be understood by a third party without knowing it, and may be an expression that can be understood only by the user described in the manual of the system according to the present embodiment. In this case, only the user can notice the peeping, and there is an advantage that the user is given an opportunity to casually prevent such peeping.
- such an alert may not only be displayed, or may emit a sound instead of the display. In this case, the sound has the advantage that the user can be more aware of the peeping.
- the information display unit may display such an alert in real time after the information generation unit detects it.
- the fact that such an alert is generated may be transmitted to the management device via the information transmission unit.
- the management device may associate and store such alerts with the user.
- the management device generates statistical information about the total number of alerts generated by each user within a predetermined period, the average number within a predetermined period, etc., sends it to the administrator terminal, and displays it on the administrator terminal. It may be possible.
- the administrator related to the administrator terminal has an advantage that the user can obtain information on how much he / she is looking into and have an opportunity to give advice on the user's working environment. ..
- the information transmission unit sends a face different from the face of the user registered in advance to the management device, further sends it to the administrator terminal, and displays it on the administrator terminal. It may be possible. Further, on the user terminal, only statistical information such as the total number of predetermined periods, the average value of the predetermined period, etc., in which a face different from the face of the pre-registered user is detected on the screen, or in advance. A face different from the registered user's face may be transmitted to the administrator terminal so that the face can be displayed on the administrator terminal.
- the user attribute information may include the duration during which the human face is continuously in the image. The duration is continued from the time when the information generation unit generates the information that there is a human face in the image after the information that there is no human face in the image, and continues to be the person in the image. It may be generated using the information of the elapsed time when the information that there is a face of is generated.
- the user attribute information may include information indicating the degree of fatigue of a person in the image.
- the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the degree of fatigue of the person in the image, and for a new image, the person in the image has been machine-learned. It may be possible to generate information indicating the degree of fatigue.
- the user attribute information may include information indicating the degree of concentration of people in the image.
- the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the degree of concentration of the person in the image, and for a new image, the person in the image has been machine-learned. It may be possible to generate information indicating the degree of concentration.
- the information indicating the degree of concentration may be specified by using information such as the movement of the line of sight, the frequency of blinking, the heart rate, the breathing, and the number of sighs.
- the machine-learned function according to the embodiment may generate information indicating the degree of concentration of the above-mentioned person based on an image and a sound.
- the machine-learned function has machine-learned the relationship between the image and the sound and the information indicating the degree of concentration of the person in the image, and the image is obtained for a new image and sound. It may be possible to generate information indicating the degree of concentration of people within. Information indicating the degree of concentration may be specified using both image and sound information such as, for example, typing sounds, eye movements, blink frequency, heart rate, respiration, and sigh frequency. For the heart rate measurement itself from the image, for example, a technique such as http://pacesync.com/ may be used.
- the information generated by the information generation unit indicating the degree of concentration of people indicates the degree of concentration above a predetermined level, it may be automatically switched to the "concentration mode" described later.
- the information indicating the degree of concentration of such persons may be used as one of the statistical information of each user.
- the user attribute information may include information indicating human health information in the image.
- the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the health information of the person in the image, and for a new image, the person in the image has been machine-learned. It may be possible to generate information indicating health information.
- the health information may include, for example, the posture of the person and / or the distance to the image pickup device of the person.
- the user attribute information may include information indicating the status of a person.
- the machine-learned function according to the embodiment has machine-learned the relationship between the image and / or the sound and the information indicating the status of the person, and the person with respect to the new image and / or the sound. It may be possible to generate information indicating the status of.
- the information including the status of the person may include information such as during a telephone call, eating, or taking a break.
- the information including the status of such a person may be determined based on any information of image only, image and sound, and sound only, as in the information used in the machine learning described above.
- the user attribute information may include information indicating the degree of trouble of a person in the image.
- the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the degree of the person's worries in the image, and the person in the image has a new image. It may be possible to generate information indicating the degree of trouble.
- machine learning the above-mentioned machine learning is performed using the relationship between an image including, for example, a person's movement and / or a person's facial expression, and the degree of trouble felt by the person in the image. good.
- the information generation unit may have a function of acquiring sound.
- the function of acquiring sound may be one using the inside of the above-mentioned image pickup device, or may be different from the above-mentioned image pickup device.
- the information generation unit has a function of acquiring sound
- the information generation unit has a machine learning unit that has machine-learned the relationship between the sound and information for determining whether or not it can occur during work. good.
- the information generation unit may use the machine learning unit to generate information for determining whether or not the acquired sound is a sound generated during work.
- the machine learning for determining whether or not the sound is generated during the work is, for example, information for determining that the sound is generated during the work with respect to the sound when a key in the keyboard is touched.
- the information generation unit may generate "information indicating the situation" of the user, which is not related to the image.
- the information indicating such a situation may be a subordinate concept of the above-mentioned user attribute information. Further, the information indicating such a situation may be a subordinate concept of the above-mentioned user dynamic attribute information.
- the information generation unit may generate information based on the information obtained in cooperation with the software that manages the schedule in the terminal device.
- the software for managing the schedule may be, for example, software having a calendar function.
- the information generation unit acquires information related to the user's schedule from software that manages the schedule in the terminal device, using information related to time such as a predetermined time zone or time, and the user's schedule information. May be generated.
- the user's "schedule information" may be a subordinate concept of information indicating the user's situation.
- the user's schedule information may include information related to the user's meeting and / or user's work information.
- the information related to the meeting may include the presence or absence of the meeting, the attendees of the meeting, the distinction between internal and external meetings, the meeting place, the meeting form, and / or the scheduled end time of the meeting.
- the meeting format may be that the meeting is a WEB meeting, or the information related to the meeting may be only the information about the meeting at the current time, and is scheduled to be held in a predetermined period such as today, today and the next day. It may contain information about the meeting.
- the information generation unit may acquire information related to the current work status input by the user and generate information indicating the status.
- the information indicating the situation may include, for example, information indicating a "concentration mode", which is information indicating that the user intends to concentrate.
- concentration mode information indicating that the user intends to concentrate.
- the information generation unit specifies the latitude and longitude of the terminal device related to the user by using a known technique, and generates the latitude and longitude of the terminal device as a subordinate concept of the information indicating the situation. You may.
- FIG. 3 is an example of information generated by the information generation unit as user attribute information, particularly as user dynamic attribute information.
- the information transmission unit has a function of transmitting information.
- the information transmission unit may transmit a part or all of the information generated by the information generation unit to one or more management devices.
- the information transmission unit may transmit such information at various timings. For example, the information transmission unit may transmit information to one or more management devices every 30 seconds, every minute, every two minutes, every three minutes, every five minutes, every ten minutes, and so on. Further, the information transmission unit may transmit the information at different timings depending on the content of the information to be transmitted. Further, even if the information to be transmitted is different from the previously transmitted information, only the information that the same information as the previously transmitted information is the same information is transmitted or the information is not transmitted. good. Further, the information transmission unit may have different transmission timings depending on the management device of the transmission destination.
- the information transmission unit may transmit the user attribute information generated by the information generation unit to one or more management devices.
- the information display unit has a function of displaying information.
- the information display unit may display information based on the information acquired from the management device.
- the information display unit may acquire and display user attribute information for a plurality of users from the management device. An example of the mode of use will be described later.
- the management device has an information management unit and an information transmission unit.
- the information management unit has a function of acquiring and managing information from one or a plurality of terminal devices.
- the timing at which the information management unit acquires information may be the timing at which information is acquired from one or a plurality of terminal devices.
- the information management unit may manage information acquired from one or more terminal devices, for example, as shown in FIG.
- the information management unit may measure and manage the time in which the human face is not continuously included in the image captured by the image pickup device related to each terminal device in the management device. That is, information on whether or not a human face is included in the image is acquired from one or more terminal devices, and the information is used to start the first time when the human face is not included. As the time, the duration that does not continuously include the human face may be measured and managed.
- the information management unit may generate information on the location of the terminal device by using the information acquired from one or more terminal devices.
- the information management unit may acquire the latitude and longitude related to the terminal device and generate information on the location of the terminal device.
- the latitude and longitude related to the terminal device may be generated in the management device using the information acquired from the terminal device by using known technology, or the latitude and longitude in the terminal device according to the user.
- the system may acquire the latitude and longitude using a known technique, and the terminal device may transmit such information to the management device, so that the information management unit may acquire the latitude and longitude of the terminal device. ..
- the information management unit may specify the administrative division as the location of the terminal device related to the user by using the acquired latitude and longitude by using the rule showing the relationship between the latitude and longitude and the administrative division.
- the administrative division has an advantage that the privacy of the user can be protected if the specific address is not specified only for the prefecture and the municipality.
- the information management department uses the acquired latitude and longitude using the rules showing the relationship between the latitude and longitude and the name associated with each place in the organization to which the user belongs. You may specify the name associated with each location within your organization. In this case, since the name is within the organization to which the user belongs, there is an advantage that the name is intuitively easy for people belonging to the organization to understand, rather than the administrative division name.
- the information management unit may or may not have a statistical function.
- the statistical function when the information management unit has the statistical function will be described below.
- the statistical function may include a function of performing statistical processing using information acquired from the terminal device.
- the information management unit may perform statistical processing on user attribute information acquired from a plurality of terminal devices.
- the total of the predetermined period and / or the average of the predetermined period may be generated, or each person may generate a correlation for the user attribute information.
- a time zone in which a specific user tends to be enrolled may be generated by statistically processing the correlation between the time zone and the presence / absence of a specific user.
- the meeting can be set according to the life rhythm of the specific user.
- a time zone in which a specific user tends to concentrate may be generated by statistically processing the correlation between the time zone and the information indicating the degree of concentration of the specific user.
- a time zone that tends to concentrate is displayed, there is an advantage that it can be used for setting a meeting according to the rhythm of concentration for such a specific user.
- statistically process the correlation between the time zone and the information indicating the degree of concentration of users within a specific group or group within the group. May generate time zones with high or low likelihood of concentration.
- time zone with high or low possibility of concentration is displayed, there is an advantage that it can be used for setting a meeting according to a specific group of a group or a rhythm of concentration of users within the group.
- time zone information indicating the degree of fatigue of a specific user, information indicating the degree of health, information indicating the degree of worries, information indicating the status of a person, and / or information indicating the degree of concentration of a person.
- a specific user may generate a specific tendency regarding the degree of fatigue / degree of health / degree of worries / degree of concentration.
- the information transmission unit has a function of transmitting information.
- the information transmission unit may transmit a part or all of the information managed by the information management unit to one or a plurality of terminal devices.
- the information transmission unit may transmit such information at various timings. For example, the information transmission unit may transmit information to the terminal device every 30 seconds, every minute, every two minutes, every three minutes, every five minutes, every ten minutes, and so on. Further, the transmission timing may be the same or different depending on the target of the information. Further, the information transmission unit may have different transmission frequencies depending on the target of the information. For example, the information transmission unit periodically transmits the user dynamic attribute information, while the user emotional attribute information is transmitted only when the user logs in, and then transmitted unless otherwise requested. You may not do it. Further, the timing at which the information transmitting unit transmits information may be the same or different for each terminal device.
- the management device may be an information processing device for business use such as a server or a cloud, but information on a mobile terminal device that can be used by a user such as a notebook computer, tablet PC, smartphone, or mobile phone in business. It may be a processing device.
- the user accesses the URL of the system according to the embodiment.
- a screen as shown in FIG. 5 may be shown.
- the user may register as a user before the screen.
- a user ID, an e-mail address, a password, etc. may be set in the user and user registration, and these user registrations may be general.
- the screen as shown in FIG. 6 may be displayed.
- the screen may display what is entitled Employee List 01.
- the system of one embodiment may operate so that information indicating a user can be displayed via a WEB browser.
- the system of one embodiment may operate so that the additional button 02, which functions to additionally display the information indicating the user on the WEB browser, can be displayed via the WEB browser.
- the system of one embodiment operates so that information indicating a user candidate to be displayed can be displayed by a dialog or the like separately displayed via a WEB browser. You can do it.
- the system of one embodiment can display the information selected by the user as the information indicating each user via the WEB browser. It may work.
- the system of one embodiment may operate so that the display target determination button 03, which indicates the target to which the information indicating the user is displayed, can be displayed via the WEB browser.
- the system of one embodiment may operate so that information indicating an index to be displayed can be displayed via a WEB browser.
- the information indicating the index to be displayed may be, for example, information indicating a predetermined set or information indicating a predetermined order.
- Information indicating an index to be displayed may be simply referred to as a "label" in the documents of the present application.
- the information indicating a predetermined set may be information indicating a set playing a predetermined role, information indicating the current situation, or other information.
- Information indicating a set that plays a predetermined role is, for example, a department such as a sales department, a development department, a research department, an accounting department, or a legal department of an organization within a corporation when the user is an employee of the corporation. It's okay.
- the information indicating the index to be displayed the information may be displayed so that each department such as the sales department, the development department, the research department, the accounting department, the legal department, etc. can select in parallel.
- the department name may match the name within the corporation.
- the information indicating the set that plays a predetermined role is not limited to the organization within the corporation, and may be the information indicating the set that plays a predetermined role in any group organization to which the user belongs.
- the department to which the logged-in user himself belongs may be displayed at the beginning of the selection candidates. In this case, there is an advantage that the information in the department to which the user himself / herself belongs can be accessed quickly. Further, as the default of the displayed target, the department to which the logged-in user himself / herself belongs may be set. In this case, there is an advantage that the user can support communication with a person in the department to which the user belongs.
- the information indicating the current situation may be described later. For example, if you select the case where you are seated, have no meeting, and are not in intensive work as information indicating the current situation, the person who is seated instead of being in a meeting or intensive work is displayed. There is an advantage that it can be used such as finding a person who can do it.
- the information indicating the predetermined order may be, for example, the character order of the user's name (aiueo order, alphabetical order, etc.) or the number order uniquely assigned to the user.
- the target person of the information indicating the user displayed in the WEB browser may be set by the user himself / herself, and for the information indicating a plurality of users set by the user himself / herself. , You may set the label.
- the user selects a close friend as a chat partner when he / she is tired from work, and selects a colleague who promotes the same or similar research as a partner who can be inspired and consulted at the time of research and development.
- the chat partner can be set as a target person who can be displayed in one WEB browser for each user, such as.
- chat partners it is possible to selectively set people who can be related to the user, such as the user's boss and subordinates, and both the chat partner and business personnel can be displayed in one WEB browser.
- the user selects a plurality of information indicating the user, and the name selected by the display target determination button 03, for example, assuming that the information indicating the plurality of selected users is displayed. It may be configurable as a label such as "normal use 1".
- the system of one embodiment may associate and store a plurality of subjects of information indicating the user selected by the user and labels indicating the plurality of subjects.
- the plurality of target persons of the information indicating the user may be one group, may be a plurality of groups, and when there are a plurality of groups, each of them may be associated and stored. For example, when one user is involved in a plurality of projects, such a list may be created for each project.
- FIG. 7 is an example of storing a plurality of labels set by one user and information indicating a user associated with each label and stored.
- the storage location may be a cache in the WEB browser used by the user, or may be stored in association with the user in the storage device in the management device.
- the information indicating the user which is classified by the above-mentioned display target determination button 03, may be displayed separately on the screen in the WEB browser.
- the information indicating the user related to the project 1 is displayed in the first column of the screen in the WEB browser
- the information indicating the user related to the project 2 is displayed in the second column of the screen in the WEB browser.
- Information indicating a user displayed in one WEB browser may be divided into a plurality of groups and displayed. By being displayed separately in a plurality of groups, the user has an advantage that he / she can immediately respond to other users who want to know the situation. Further, in the mode in which the information indicating the users in each group is displayed separately in the plurality of groups, the information indicating the users in each group may be exclusive or may be partially duplicated.
- the system of one embodiment may operate so that each user can display information 04 indicating the current status, which is information indicating the current status, via a WEB browser.
- the information indicating the current situation the information indicating the user's situation may be displayed in characters. For example, it may be in the presence (seated), away from the seat, offline, concentrated mode, and the like. Further, the information indicating the current situation may display information indicating what kind of situation each user is currently in, in addition to the characters or by color instead of the characters.
- FIG. 8 shows a relationship in which color information displayed in association with information acquired by the system of one embodiment is stored. Such a relationship may be remembered. In this figure, it is shown that each color is set to be displayed according to various information.
- the status and color to be displayed are set according to the presence / absence of login, the presence / absence of the centralized mode, the presence / absence of input of the WEB conference button, the degree of leaving time, and / or the presence / absence of a conference. More specifically, if there is no login, "offline" is displayed and grayed out. Assuming that you are logged in, in the intensive mode, "Intensive work” is displayed and the color is orange. And, assuming that the centralized mode is off, if there is an input to the WEB conference button, it is shown in red. Further, on the premise that the input to the WEB conference button is off, the display and the color may be changed and displayed according to the elapsed time. In particular, when the leaving time is displayed according to the elapsed time, there is an advantage that the user can understand how much time he / she is away from.
- the system of one embodiment may operate so that the information 05 indicating the current location, which is the information indicating the current location of each user, can be displayed via the WEB browser.
- the information indicating the current location may be information indicating a location in the group to which the user belongs and / or information indicating a predetermined administrative division.
- the information indicating the location in the group to which the user belongs may be, for example, the name, abbreviation, or the like of each office, each factory, each branch, each sales office, etc. within the organization such as the corporation to which the user belongs. ..
- the user has an advantage that it can be understood by information that is easier to understand within an organization such as a corporation to which the user belongs.
- the information indicating the administrative division may be abstracted within a predetermined range. For example, information indicating a municipality may be included, but numerical information that is more specific than a municipality may not be included. In such a case, there is an advantage that the privacy of the user can be protected.
- the system of one embodiment may operate so that the static attribute information 06, which is the static attribute information of each user, can be displayed via the WEB browser.
- the static attribute information includes, for example, an icon indicating the user himself / herself, a user's name, a user's management number, a user's department name, a user's status, a user's related project, and the like. May include.
- the icon indicating the user himself / herself may include a fixed image obtained by capturing the user in the past or an image of an avatar based on the user's real-time image from the viewpoint of identifying the user.
- the above-mentioned avatar is, for example, a program on the WEB browser related to the user terminal that has acquired such an image based on an image that captures the user in real time, and generates the movement of the corresponding avatar, and the real time of the avatar.
- the movement may be realized by transmitting the movement to the management terminal, and the management terminal transmits the real-time movement of the avatar to each user terminal and displays the real-time movement of the avatar on each user terminal.
- the program running on the WEB browser can generate the movement of the avatar according to the real-time movement of the user, which has the advantage of being able to share the movement with other users while protecting the privacy of the user.
- the movement of the avatar described above the movement of the skeleton of the specified person may be reflected in the movement of the avatar by specifying the movement of the skeleton of the person in the image of the person captured by the machine learning unit.
- the program executed on the WEB browser sends the image itself acquired from the image pickup device to the management device from one terminal terminal, not as the information in the user attribute information, and the management device. May be configured to transmit the image to each terminal device other than the one terminal device so that the real-time image of one user can be viewed on the WEB browser related to each terminal device. In this case, there is an advantage that a real-time image of one user can be seen by each user.
- the system of one embodiment may operate so as to be able to display the contact providing means 07, which provides the means for making contact with each user via the WEB browser.
- the contact providing means 07 may cooperate with another application and activate a means for enabling contact with the user associated with the contact providing means 07.
- the contact providing means is a terminal device that creates and activates a new e-mail addressed to a user associated with the display in software installed in the terminal device that can send and receive e-mail. Create and launch a new one addressed to the user associated with the display in the software that can execute voice and / or chat installed in, and / or make a call that can be executed on the terminal device. It may be something that can activate a phone with the user associated with the display in the function as the call destination.
- the system itself of one embodiment does not have to have a constant voice conversation function as a tool for communication means.
- the user can feel reassured that the voice conversation is not always performed, and can activate the voice conversation function by another application only when necessary, so that the privacy can be further protected.
- the system of one embodiment may operate so as to be able to display "WEB conference" 08, which temporarily abandons the control authority of the image pickup device related to the user, via the WEB browser.
- the system of one embodiment may suspend the access for acquiring the image from the image pickup device according to the user terminal for the first predetermined period. By stopping the access for acquiring the image for the first predetermined period, the system of one embodiment tries to access the image pickup device related to the user terminal again before the user starts the WEB conference. It is possible to prevent depriving the authority of the image pickup device.
- the user has an advantage that the application related to the WEB conference can have the access authority of the image pickup device related to the user.
- such a configuration has an advantage that a conflict between the one image pickup device can be prevented because there is often only one image pickup device capable of taking an image of the user's face.
- an external terminal such as a USB, a smartphone, a tablet PC, or the like has an image pickup direction of one image pickup device.
- the image pickup device has the same image pickup direction as the display direction of the display device. Has the advantage of being able to prevent conflicts between the same image pickup devices. Further, after the elapse of the first predetermined period, the system of one embodiment has a function of attempting access for acquiring an image from the image pickup device related to the user terminal every second predetermined period. It's okay. With the function that automatically tries to access to acquire an image in this way, even if the user forgets to set the image pickup device to be used by the system according to the embodiment after a WEB conference or the like, one implementation is performed. There is an advantage that the system according to the form can automatically use the image pickup device.
- system of one embodiment may operate so that the button 09 for accepting the input for the user to enter the centralized mode can be displayed via the WEB browser.
- the user entering the centralized mode is transmitted to the terminal device of another user as in the embodiment described later, there is an advantage that the intention of the user can be respected.
- the system of one embodiment may have a chat function.
- the chat function may be a normal chat function, or may be a chat function having one or more of the following functions instead of the normal chat function.
- the chat function is activated by inputting to the call function call icon 01 associated with each user, which is displayed on the panel showing each user, as shown in FIG. 15, for example. good.
- the activation may be a chat function addressed to the user associated with the icon.
- FIG. 16 shows an example of a screen after the icon is selected by clicking or the like, and is an example in which a chat message to the other party is displayed so as to be inputtable. The user may be able to enter a message for the other user in such a box and select "Send" to send a message addressed to the user associated with the call icon 01.
- the chat function according to the embodiment may be capable of displaying a notification icon 01 notifying the reception of a chat message at the upper part of the screen, for example, as shown in FIG.
- the notification icon may be associated and displayable, for example, with the number of messages received when a chat message to the user is received.
- a part or all of a part or all of the received messages may be a user related to the sender of each message. It may be associated with the indicated information and displayed as a received message 02.
- the message 03 related to each user may be limited to a predetermined number of characters in advance.
- the displayed space is limited to a predetermined range and the list of received messages can be understood first.
- the user may respond to these messages with a negative response of "I'm sorry" 04, or may respond to each message with a specific message of "Reply” 05. good.
- the message 03 related to each user is a part of the received message (a part of the received message and / or a part of the message), the whole can be seen.
- Click "More" 06 to display the entire received message (including the list of all received users and / or the limited range of messages related to one received user). You can do it.
- FIG. 18 is an example of a screen when "Reply” is selected above. If you select "Reply” for only one message among the messages for multiple users who have received the message, the message for the selected user is displayed and you can reply. It may be configured as follows. Here, a chat screen between the selected user and himself / herself is displayed, and the history of past message exchanges may or may not be retained.
- FIG. 19 is an example of a screen when "more" is selected as described above.
- one or more messages including the received message may be displayed simultaneously in the same window. If it can be displayed in the same window, there is an advantage that you can understand the message including yourself at a glance.
- it may be provided with a function that enables input of a message addressed to a plurality of destinations within the same display for a part or all of a plurality of messages displayed as a message including oneself. In this case, for each message addressed to you, part or all of the messages addressed to you within the specified period will be displayed at the same time without taking steps such as displaying, replying, and inputting the message. There is an advantage that you can enter the reply information.
- an input message for each destination is tentatively displayed for input to multiple destinations. Even if they are different, there is an advantage that the processing speed is improved by being able to input each message to a plurality of destinations in one displayed window.
- the message 02 may be individually input as a reply and the reply 03 may be sent. Further, instead of such a response, it may be possible to reply by the fixed phrase 04.
- the fixed phrase as a specific character string may be one that the user usually uses. Further, the fixed phrase may be the same character string for all users, or may be a different character string for each user. In the latter case, a fixed phrase used by each user may be set. Each fixed phrase set by each user may be stored in a cache in the WEB browser related to each user, or may be associated with each user in the management device and stored as a fixed phrase.
- chat function may be accompanied by "OK” and "Sorry” buttons that simply convey Yes / No to the message as an input function.
- reply to the message can be easily performed.
- the "OK” button may be displayed together with or in place of such a display.
- chat function is not specified in the drawing as a transmission function
- an icon for activating a function capable of creating the same message may be displayed for a plurality of users.
- the same message may be simultaneously transmitted according to the transmission instruction.
- a plurality of users as destinations of a message may be specified from various viewpoints, and a plurality of users may be specified by a predetermined filter. For example, it may be specified based on the user emotional attribute information of the user, it may be specified based on the user dynamic attribute information of the user, the user dynamic attribute information of the user, and the user dynamic attribute information of the user. It may be specified based on user emotional attribute information.
- the user When based on user emotional information, for example, the user may belong to the same group as the group to which the user belongs, or the user belongs to the same group as the group within the group to which the user belongs. You may.
- the former is, for example, a message to everyone in the corporation, and the latter is a message to users who belong to the same group such as the same department or project.
- user dynamic attribute information for example, as multiple users as the other party of a message, only the currently present user, only the person currently in the predetermined office, the location in the predetermined range.
- the display of the past history may disappear after a predetermined time has passed.
- the screen space can be effectively used by not displaying the history of past messages.
- the system according to the embodiment may have a function of determining whether or not the received message has been read based on the image captured by the user.
- a function has a machine learning unit that machine-learns the relationship between an image, information related to a received message, and whether or not it has been read, and the image newly acquired by the machine-learned machine learning unit. It may be determined whether or not the message has been read based on the information related to the received message.
- the information relating to the message may include the display position of one or more received messages and / or the display timing of the message. Further, the display position of the received one or more messages may be the case where the whole of the one message is displayed, or the stage where only a part of the one message is displayed.
- whether or not the displayed one or more messages have been read for the display position is determined as to whether or not all the messages have been displayed and whether or not all the displayed messages have been read for the entire displayed one or more messages. It may be a message, or it may be determined whether or not each message among the displayed one or a plurality of messages has been read. In the former case, the presence or absence of read is determined for the entire displayed one or more messages, but in the latter case, each message of the displayed one or more messages is generated. The determined read presence / absence may be generated for. In such a configuration, for example, the image may use the direction of the line of sight of a person in the image, but is not limited to this.
- information determined to be read and / or unread for all or each of the received messages is transmitted to the user terminal related to the sender of each message via the management device. Then, the read or unread information of each message may be displayed on the user terminal.
- the sender of the message can understand whether or not the message has been read even when the user does not specifically click based on the image related to the user.
- Such a function may coexist with a function in which the information browsed by the user by clicking each message is displayed at the sender of the message, or may have only such a function.
- the system according to one embodiment may have a WEB call function.
- the WEB call may have a normal voice function, but may have a function different from the normal voice function.
- the system according to the embodiment may acquire information indicating the stress status of the user in real time based on the acquired image.
- the information indicating the stress situation may be, for example, a numerical value indicating the degree of stress or a rank.
- the numerical value may be, for example, a numerical value between 1 and 100 when the stress-free state is 0 and the stress is strong as 100, and the rank may be a plurality of stresses such as low, medium, and strong. It may be the one to which one is specified.
- the information indicating the stress status is obtained by the system according to the embodiment having a machine learning unit in which the relationship between the image and the information indicating the stress status has been machine-learned and newly acquired during a WEB call. On the other hand, it may be generated by applying such a machine learning unit.
- a machine learning unit can be obtained from an image during a web call, for example, behavior such as the user looking at the upper left / upper right, scratching the chin / forehead / head, increasing / decreasing the number of blinks, increasing / decreasing the heart rate, etc.
- Information such as the above may be acquired and recorded, and information indicating the stress status of the user in the image may be generated based on such a state.
- the generated information indicating the stress situation may be transmitted to other users who are using the WEB call function. That is, the information indicating the stress status may be displayed on the WEB browser of the user terminal related to another user via the management device.
- the user has an advantage that it is possible to communicate according to the subtleties of the other party, especially when the image of the other party of the WEB call cannot be viewed in real time. Further, even if the user can see the image of the other party in real time, there is an advantage that it is possible to communicate according to the subtleties of the other party by referring to the information indicating stress.
- the information indicating the stress status is stored as statistical information in the management device as an average value of the information indicating the stress within a predetermined period, and is transmitted to the terminal device related to the user, so that the user himself / herself can use the information. It has the advantage of being available as objective information about stress.
- the information indicating stress as statistical information in the management device satisfies a predetermined condition, a warning is sent to the terminal device related to the user and the stress of oneself is sent on the terminal device related to the user. Since the degree of is displayed as satisfying a predetermined condition, there is an advantage that the user himself / herself can understand the degree of his / her own stress.
- the information indicating such stress indicates a predetermined condition
- it is expected to grasp the stress status of the administrator terminal and the user related to the management device (referred to as "supervisor" in the documents of the present application).
- the user related to the supervisor may grasp the degree of stress of the user related to the employee by being transmitted and displayed to the terminal device according to (may).
- the prescribed conditions for the user to grasp the degree of his / her own stress and the prescribed conditions for the user pertaining to the supervisor of the user to grasp the degree of stress of the user pertaining to the employee may be the same or different.
- the predetermined condition for the user related to the supervisor to grasp the degree of stress of the user related to the employee is the predetermined condition for the user himself / herself to grasp the degree of stress of himself / herself.
- the degree of stress may be set higher.
- the user can grasp by himself / herself and have an opportunity to deal with it by reviewing his / her life, while at the stage of high stress level, the user related to the supervisor.
- the contact is notified to, there is an advantage that it is possible to realize a situation in which the user related to the supervisor can grasp the situation only when there is a possibility that the user himself / herself cannot respond.
- the supervisor may be the employer of the employee or the person in charge of the personnel affairs of the employee.
- the stress state has been described as an example, but the description is not limited to this, and it may be used to generate information indicating the degree of interest such as the presence or absence of concentration on WEB calls and the presence or absence of interest. good.
- the system according to an embodiment related to a program executed on a WEB browser related to a user terminal has a machine learning unit in which the relationship between an image and information indicating the degree of interest is machine-learned. By applying the machine learning unit to a newly acquired image during a WEB call, information indicating the degree of interest in the WEB call may be generated.
- the information indicating the degree of interest may include, for example, a numerical value indicating the degree of interest or a rank.
- the numerical value may be, for example, a numerical value between 1 and 100 when the state of no interest is 0 and the state of interest is 100, and the rank indicates the degree of interest. It may be one in which one of a plurality of items such as strong is specified.
- the information indicating the degree of interest may be processed in the same manner as the information processing for the information indicating the stress situation described above. For example, in a terminal device related to one user, information on the degree of interest such as concentration and interest in a web call generated based on an image captured by the image pickup device is information of the other party of the web call.
- WEB calls are sent to the terminal device related to the user via the management device, and information on the degree of interest is displayed by the program executed on the WEB browser related to the terminal device related to the other party of the WEB call.
- the user related to the other party of the WEB call can understand the degree of interest of one user and can communicate according to the subtleties of the other party.
- the system of one embodiment may be, for example, the one shown in FIG.
- an example of the data possessed by the management device 01 and the terminal device 02 may be shown as shown in FIG.
- the management device shows an example of being executed on the cloud, but the present invention is not limited to this.
- the management device may have the current information as a database about the information indicating the situation of each user.
- past information may be included in the information indicating the situation of each user.
- information such as contact information and name of each user may be included. The information in these databases may be appropriately accessible from the terminal device.
- the terminal device when one user uses a means of contacting another user, the terminal device also obtains information such as an e-mail address and a telephone number of the other user from such a database. You may get it.
- databases various types of databases such as relational databases and object-oriented databases may be used, and the formats and types thereof are not limited.
- Embodiment 2 In the second embodiment, when the first user who uses the system according to the embodiment according to the present application moves from the image pickup field of view of the image pickup device according to the first terminal device according to the first user to the outside of the image pickup field of view. The flow of the above will be described with reference to FIG.
- the first image pickup device according to the first terminal device according to the first user is taking an image of the first user, and the image is taken from the first image pickup device.
- the acquired program executed on the WEB browser in the first terminal device generates information indicating that the image pickup field of the first image pickup device has a person's face, and indicates that the person's face is present.
- the information was transmitted to the management device as one piece of information in the user dynamic attribute information. Further, the management device acquires information indicating that there is a human face as one piece of user dynamic attribute information, which is one piece of user attribute information acquired from the first terminal device. I remember.
- the management device transmits information including information indicating that the person has a face to the second terminal device different from the first terminal device, and executes the information on the WEB browser in the second terminal device.
- the program being executed acquires such information, and the first user is seated using the information indicating that there is a person's face about the first user on the WEB browser in the second terminal device. Information is displayed.
- Step 1 The face of the first user goes out of the imaging field of view of the first imaging device.
- the program executed on the WEB browser according to the first terminal device which has acquired the image not including the face of the first user from the first image pickup device, has no human face based on the image. Generate information to indicate that.
- the timing at which the program acquires an image from the first image pickup apparatus may always be acquired as a moving image or may be acquired at a predetermined interval.
- Step 2 Such a program transmits information including information indicating that there is no human face to the management device at a predetermined timing.
- the predetermined timing is acquired in a relatively short period of time, for example, every 30 seconds, every 1 minute, every 2 minutes, every 3 minutes, every 5 minutes, every 10 minutes, whether or not the user is seated is more real-time. Has the advantage of being able to send information to the management device.
- Step 3 The management device stores information indicating that there is no human face for the first user, and at a predetermined timing, the management device transfers the information to a plurality of terminal devices including the second terminal device different from the first terminal device. Send information, including information indicating that there is no face.
- the management device changes from the information indicating that there is a human face to the information indicating that there is no human face for the first time, the measurement of the elapsed time of the absence state may be started, and the elapsed time is described above. It may be transmitted to a plurality of terminal devices.
- the management device may or may not transmit these information to the first terminal device in the same manner.
- Step 4 The program executed on the WEB browser related to the second terminal device acquires information including information indicating that there is no person's face related to the first terminal device, and associates it with the first user, for example, while away from the desk. As certain information, it operates so that it can be displayed on a WEB browser.
- the said program is the first user. It may operate so that the elapsed time taken in association with can be displayed on the WEB browser.
- Step 5 The second user related to the second terminal device can see the display that the first user is away from his / her seat, and has an advantage that he / she can consider communication with the second user based on such a state. Further, when the elapsed time of leaving the seat of the first user is displayed on the WEB browser related to the second terminal device, the second user can estimate the situation of the first user and consider communication. There is. For example, if the first user's absence time is 60 minutes at the stage of 1 hour after the start of work, a business trip, flex, or a break may be considered, but if it is within 15 minutes, a break may be considered. ..
- the first user's leave time is 30 minutes or more, it is possible that he went out to eat, but if the first user's leave time is within 15 minutes, the time is reached. Depending on the situation, there is a possibility that it will come back soon.
- Embodiment 3 In the third embodiment, the flow in which the first user who uses the system according to the embodiment according to the present application holds a WEB conference using the image pickup device according to the terminal device according to the first user is shown in the figure. 12 will be described. Also in this embodiment, it is assumed that the state is the same as that in the above-mentioned second embodiment.
- Step 1 First, the first user inputs an input to the WEB conference button displayed on the WEB browser related to the first terminal device at the stage immediately before the WEB conference time.
- the program executed on the browser related to the first terminal device accepts the input of the WEB conference button, stops the access to the first image pickup device, and stops the acquisition of the image from the first image pickup device.
- Such a program starts measuring the time at the same time as accepting the input of the WEB conference button. The measurement of such time is used to determine the conditions for resuming access to the first image pickup apparatus.
- Such a program suspends access to the first image pickup apparatus until the lapse of a first predetermined time, which is a condition for resuming access to the first image pickup apparatus.
- the application in the first terminal device can acquire access to the first image pickup device, so that the first user has a grace period for preparing for the WEB conference at least for the first predetermined period. There is.
- Step 2 The first user starts a WEB conference.
- any application in the first image pickup device including the application related to the WEB conference can access the first image pickup device.
- "accessible to the image pickup device” may mean having the authority to control the image pickup device.
- the above-mentioned program attempts to access the first imaging device every second predetermined period after the lapse of the first predetermined period, the first user will try to access the first predetermined period after the lapse of the first predetermined period.
- the above program has the access authority of the first image pickup device. In such a case, the first user who plans to start the WEB conference needs to return to step 1 described above and input to the WEB conference button again.
- Step 3 The program attempts to access the first imaging device every second predetermined period after the lapse of the first predetermined period.
- the above-mentioned program acquires the authority if the access is possible, that is, the authority to control the first image pickup apparatus is obtained.
- Step 4 The first user ends the WEB conference. Due to the termination of the WEB conference, the application related to the WEB conference relinquishes the access authority to the first imaging device, so that after the lapse of the above-mentioned first predetermined period and at the timing of each second predetermined period.
- the above-mentioned program acquires the access authority related to the first image pickup apparatus. Even if the program attempts to access the first image pickup device every second predetermined period, even if the first user forgets to set the first image pickup device to be used in the above-mentioned program, it is automatically performed. Therefore, there is an advantage that the above-mentioned program can attempt to acquire access to the first image pickup apparatus and make it possible to detect the seated or absent state of the first user.
- FIG. 13 is an example diagram illustrating the logic by which the above-mentioned program attempts to access the first image pickup apparatus.
- the above program (1) confirms the connection status of the camera to the first image pickup device every second predetermined period, (2) initializes the image pickup device if it is not connected, and (3) succeeds in initialization. At the time and if it is already connected, AI processing is performed on the image, and (4) if initialization fails (for example, when another WEB conference application uses the first image pickup device), this is performed. Processing such as recording and returning to (1) may proceed.
- Embodiment 4 the flow when the first user who uses the system according to the one embodiment according to the present application wants to concentrate will be described with reference to FIG. Also in this embodiment, it is assumed that the state is the same as that in the above-mentioned second embodiment.
- Step 1 when the first user wants to concentrate, he / she inputs to the centralized mode displayed on the WEB browser related to the first terminal device.
- the program executed on the browser related to the first terminal device accepts the input of the centralized mode.
- Step 2 Such a program transmits information including information indicating that it is in the centralized mode to the management device at a predetermined timing.
- the predetermined timing is transmitted in a relatively short period of time, for example, every 30 seconds, every 1 minute, every 2 minutes, every 3 minutes, every 5 minutes, every 10 minutes, the first user is in the centralized mode.
- the information can be transmitted to the management device in real time.
- Step 3 The management device stores information indicating that the first user is in the centralized mode, and at a predetermined timing, the first user is sent to a plurality of terminal devices including the second terminal device different from the first terminal device. Sends information, including information indicating that is in centralized mode.
- the management device may or may not transmit these information to the first terminal device in the same manner.
- Step 4 The program executed on the WEB browser related to the second terminal device acquires information including information indicating that it is in the centralized mode related to the first terminal device, and associates it with the first user, for example, information in the centralized mode. It works so that it can be displayed on the WEB browser.
- Embodiment 5 is another embodiment.
- the system of one embodiment may be used among the users in the above.
- the user may be a user who belongs to a part of a plurality of organizations.
- Cases in which each user in a plurality of organizations interacts with each other may be, for example, an exchange including a chat between researchers in joint research, or a related person who is in the process of concluding a business alliance.
- the user may use the system of one embodiment even in a real space such as a shared office.
- a real space such as a shared office
- one of the information processing devices related to each user is, for example, WIFI technology related to the wireless communication.
- the specific position can be specified by using. Therefore, for example, while displaying the position of each user in the shared office, the affiliation and specialty of each user can be disclosed to a certain extent, shared among each user, and information can be obtained from each other. You may do it.
- a real space such as a shared office
- information that can be disclosed may be registered and shared externally or in such a shared office.
- Information that can be disclosed includes the user's name, specialty, range of interest, and the like.
- the system of one embodiment may have a function of sharing information that one user wants to communicate with. More specifically, one user may input information indicating that he / she wants to communicate with the above-mentioned program on the WEB browser.
- the above-mentioned program may accept input of information indicating that such communication is desired and transmit it to the management device at a predetermined timing.
- the management device may transmit information desired for communication associated with such a user to a terminal device within a predetermined range.
- the predetermined range may be, for example, one shared office, a part thereof, or a plurality of shared offices. It may be separated by floor or room in the shared office.
- the information desired to communicate with such one user may be displayed by the operation of the above-mentioned program executed in the WEB browser on the user terminal within the above-mentioned predetermined range. Therefore, the user within the predetermined range may understand that one of the above-mentioned users wants to communicate. Thereby, the person who desires may start the communication by using the system of one embodiment, or may directly communicate in the real space. In addition, in relation to the above-mentioned desire for communication, for example, it is possible to select whether to desire only communication in the virtual space, only communication in the real space, or either of these. Yes, and such information may be shared so that it can be displayed on other user terminals as well. Similarly, the object of communication and comments may also be associated.
- the subject of communication may be, for example, a topic related to a specific business or a topic related to a specific research field.
- the system may have a matching function between users.
- the matching function may perform matching based on the information indicating the current situation of the user.
- the information indicating the current situation may be, for example, information indicating that communication is desired.
- the information desired to be communicated may be input in each user terminal and transmitted to the management terminal.
- matching may be performed between users who desire communication by associating users who are associated with information that they desire communication.
- it is displayed to each user to be matched that they want to communicate with each other by the operation of the program executed on the WEB browser of each user terminal. You can do it.
- another communication tool such as SNS may be further operated to provide a dedicated communication method between users who desire communication.
- the system according to the present invention may be composed of one or a plurality of information processing devices.
- the information processing device 10 according to the present invention may include a bus 15, an arithmetic unit 11, a storage device 12, and a communication device 16. Further, the information processing device 10 in one embodiment may include an input device 13 and a display device 14. It is also directly or indirectly connected to the network 17.
- the bus 15 may have a function of transmitting information between the arithmetic unit 11, the storage device 12, the input device 13, the display device 14, and the communication device 16.
- arithmetic unit 11 is a processor. This may be a CPU or an MPU. Further, the arithmetic unit in one embodiment may include a graphics processing unit, a digital signal processor, and the like. In short, the arithmetic unit 12 may be any device that can execute the instructions of the program.
- the storage device 12 is a device for recording information. This may be either an external memory or an internal memory, and may be either a main storage device or an auxiliary storage device. Further, a magnetic disk (hard disk), an optical disk, a magnetic tape, a semiconductor memory, or the like may be used. Further, it may have a storage device via a network or a storage device on the cloud via a network.
- the registers, L1 cache, L2 cache, etc. that store information at a position physically close to the arithmetic unit may be included in the arithmetic unit 11, but in the design of the computer architecture, As a device for recording information, the storage device 12 may include these.
- the arithmetic unit 11, the storage device 12, and the bus 11 may be configured to cooperate with each other to execute information processing.
- the storage device 12 can include a part or all of a program capable of executing the process according to the present invention. In addition, data necessary for executing the process according to the present invention can be appropriately recorded. Further, the storage device 12 in one embodiment may include a database.
- the above describes the case where the arithmetic unit 12 is executed based on the program provided in the storage device 13, but it is one of the forms in which the bus 11, the arithmetic unit 12 and the storage device 13 are combined.
- part or all of the information processing according to the present invention may be realized by a programmable logic device capable of changing the hardware circuit itself or a dedicated circuit in which the information processing to be executed is determined.
- the input device 13 inputs information, but may have other functions.
- Examples of the input device 14 include an input device such as a keyboard, a mouse, a touch panel, or a pen-type instruction device.
- the display device 14 has a function of displaying information.
- a liquid crystal display, a plasma display, an organic EL display, and the like can be mentioned, but in short, any device that can display information may be used.
- the input device 13 may be partially provided like a touch panel.
- the network 17 transmits information together with the communication device 16. That is, it has a function of transmitting information of 10 which is an information processing device to another information terminal (not shown) via a network 17.
- the communication device 16 may use any connection type, and may be IEEE1394, Ethernet (registered trademark), PCI, SCSI, USB, 2G, 3G, 4G, 5G, or the like.
- the connection to the network 17 may be either wired or wireless.
- the information processing device may be a general-purpose type or a dedicated type. Further, the information processing device may be a workstation, a desktop personal computer, a laptop personal computer, a laptop personal computer, a PDA, a mobile phone, a smartphone or the like.
- the system according to the present invention may be configured by a plurality of information processing devices.
- the plurality of information processing devices may be internally connected or may be externally connected.
- the system according to the present invention may be of various types of devices.
- the system according to the present invention may be a stand-alone system, a server-client system, a peer-to-peer system, or a cloud system.
- the system according to the present invention may be a stand-alone information processing device, may be composed of a part or all information processing device of a server-client type, or may be a part or all information processing of a peer-to-peer type. It may be composed of devices, or may be composed of a part or all of information processing devices in cloud format.
- the owner and the manager of each information processing device may be different.
- the information processing device 10 may be a physical existence or a virtual one.
- the information processing apparatus 10 may be virtually realized by using cloud computing.
- the term "button" in the document of the present application may be a physical button, or may be a display displayed on a display device that can accept input such as a touch screen and can accept input. ..
- the management device acquires information from a plurality of terminal devices, the timing of acquisition from each terminal device may be acquired at the same time or at different times.
- the management device transmits information to a plurality of terminal devices, the information may be transmitted to each terminal device at the same time or may be transmitted at different times.
- the program according to one embodiment may itself have an instruction for transmitting and / or receiving information, and sets the information so that another program can transmit and / or receive the information. May be only.
- the processes and procedures described in the documents of the present application may be feasible not only by those explicitly described in the embodiments but also by software, hardware or a combination thereof. Further, the processes and procedures described in the documents of the present application may be able to be implemented by various computers by implementing the processes and procedures as a computer program. In particular, some or all of the functions realized by the term "system" as used in the documents of the present application may be realized by a program that can be executed on such an information processing apparatus. Further, these computer programs may be stored in a storage medium. Also, these computer programs may be stored on a non-transient or temporary storage medium.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Human Resources & Organizations (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- Economics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Quality & Reliability (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Information Transfer Between Computers (AREA)
Abstract
[Problem] To provide a system capable of increasing communication opportunities more appropriately. [Solution] The present invention provides a system comprising a first transmission unit capable of transmitting a program executable in a web browser of a first terminal device associated with a first user to the first terminal device, an acquisition unit capable of acquiring information including user attribute information which is associated with the first terminal device and which is generated by a function trained by machine learning in the program executed in the web browser, the function using an image captured by an imaging device associated with the first terminal device, and a second transmission unit capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device, wherein the user attribute information includes information indicating the presence or absence of the first user in the image.
Description
本出願において開示された技術は、情報処理システム、情報処理装置、サーバ装置、プログラム、又は方法に関する。
The technology disclosed in this application relates to an information processing system, an information processing device, a server device, a program, or a method.
近年、勤務形態の自由化や社会的事情により、旧来の会社の自席での勤務形態に加えて、在宅勤務やシェアオフィスなどで業務に携わる者が増加している。
In recent years, due to the liberalization of working styles and social circumstances, the number of people who are engaged in work at home or in shared offices is increasing in addition to the traditional working styles of the company at their own seats.
このように、個々人が自由な形で業務を推進できるメリットは種々あるものの、個々人が業務を推進する場所が多様となることから、従来のように、Face to Faceのコミュニケーションの機会が低下することとなる。そこで、一定程度プライバシーの保護を可能としつつ、コミュニケーションの機会を向上させる技術が必要である。そこで、本発明の様々な実施形態は、上記の課題を解決するために、情報処理システム、情報処理装置、サーバ装置、プログラム、又は方法を提供する。
In this way, although there are various merits that individuals can freely promote their work, the opportunities for face-to-face communication are reduced as in the past because the places where each individual promotes their work are diverse. Will be. Therefore, there is a need for technology that improves communication opportunities while enabling the protection of privacy to a certain extent. Therefore, various embodiments of the present invention provide an information processing system, an information processing apparatus, a server apparatus, a program, or a method in order to solve the above-mentioned problems.
本願の第1実施形態に係るシステムは、
第1利用者に係る第1端末装置に対し、前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、送信可能な第1送信部と、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、取得可能な取得部と、
前記利用者属性情報に基づく情報を、前記第1端末装置とは異なる第2端末装置に送信可能な第2送信部と、
を備えるシステムであって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
システム。 The system according to the first embodiment of the present application is
A program that can be executed on the WEB browser of the first terminal device to the first terminal device related to the first user can be transmitted to the first transmission unit.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. With the acquisition unit that can acquire information including
A second transmission unit capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device, and
It is a system equipped with
The user attribute information includes information indicating the presence or absence of the first user in the image.
system.
第1利用者に係る第1端末装置に対し、前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、送信可能な第1送信部と、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、取得可能な取得部と、
前記利用者属性情報に基づく情報を、前記第1端末装置とは異なる第2端末装置に送信可能な第2送信部と、
を備えるシステムであって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
システム。 The system according to the first embodiment of the present application is
A program that can be executed on the WEB browser of the first terminal device to the first terminal device related to the first user can be transmitted to the first transmission unit.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. With the acquisition unit that can acquire information including
A second transmission unit capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device, and
It is a system equipped with
The user attribute information includes information indicating the presence or absence of the first user in the image.
system.
本願の第2実施形態に係るシステムは、第1実施形態に係るシステムにおいて、
前記プログラム内の機械学習済み機能は、画像と、利用者属性情報と、の関係を機械学習したものであって、画像に対して、対応する利用者属性情報を生成可能なものであり、
前記利用者属性情報は、前記第1端末装置に係る前記画像を含まない、ものである、
システム。 The system according to the second embodiment of the present application is the system according to the first embodiment.
The machine-learned function in the program is machine-learned about the relationship between the image and the user attribute information, and can generate the corresponding user attribute information for the image.
The user attribute information does not include the image related to the first terminal device.
system.
前記プログラム内の機械学習済み機能は、画像と、利用者属性情報と、の関係を機械学習したものであって、画像に対して、対応する利用者属性情報を生成可能なものであり、
前記利用者属性情報は、前記第1端末装置に係る前記画像を含まない、ものである、
システム。 The system according to the second embodiment of the present application is the system according to the first embodiment.
The machine-learned function in the program is machine-learned about the relationship between the image and the user attribute information, and can generate the corresponding user attribute information for the image.
The user attribute information does not include the image related to the first terminal device.
system.
本願の第3実施形態に係るシステムは、第1又は2実施形態に係るシステムにおいて、
前記プログラムは、所定の入力を受け付けた後の第1所定の期間、前記プログラムが実行されている前記第1端末装置に係る前記撮像装置に対して、前記画像を取得するためのアクセスをしない、
システム。 The system according to the third embodiment of the present application is the system according to the first or second embodiment.
The program does not access the image pickup device according to the first terminal device in which the program is executed for the first predetermined period after receiving the predetermined input to acquire the image.
system.
前記プログラムは、所定の入力を受け付けた後の第1所定の期間、前記プログラムが実行されている前記第1端末装置に係る前記撮像装置に対して、前記画像を取得するためのアクセスをしない、
システム。 The system according to the third embodiment of the present application is the system according to the first or second embodiment.
The program does not access the image pickup device according to the first terminal device in which the program is executed for the first predetermined period after receiving the predetermined input to acquire the image.
system.
本願の第4実施形態に係るシステムは、第1乃至3のいずれか一の実施形態に係るシステムにおいて、
前記プログラムは、所定の入力を受け付けた後の第1所定の期間の経過後、前記プログラムが実行されている前記第1端末装置に係る前記撮像装置に対して、前記画像を取得するためのアクセスを定期的に行う、
システム。 The system according to the fourth embodiment of the present application is the system according to any one of the first to third embodiments.
The program is an access for acquiring the image to the image pickup device according to the first terminal device in which the program is executed after the elapse of the first predetermined period after receiving the predetermined input. Do regularly,
system.
前記プログラムは、所定の入力を受け付けた後の第1所定の期間の経過後、前記プログラムが実行されている前記第1端末装置に係る前記撮像装置に対して、前記画像を取得するためのアクセスを定期的に行う、
システム。 The system according to the fourth embodiment of the present application is the system according to any one of the first to third embodiments.
The program is an access for acquiring the image to the image pickup device according to the first terminal device in which the program is executed after the elapse of the first predetermined period after receiving the predetermined input. Do regularly,
system.
本願の第5実施形態に係るシステムは、第1乃至4のいずれか一の実施形態に係るシステムにおいて、
前記利用者属性情報に基づく情報は、前記利用者属性情報に係る前記第1利用者が継続して画像内に含まれていないと判定されている時間を含む、
システム。 The system according to the fifth embodiment of the present application is the system according to any one of the first to fourth embodiments.
The information based on the user attribute information includes a time when it is determined that the first user related to the user attribute information is not continuously included in the image.
system.
前記利用者属性情報に基づく情報は、前記利用者属性情報に係る前記第1利用者が継続して画像内に含まれていないと判定されている時間を含む、
システム。 The system according to the fifth embodiment of the present application is the system according to any one of the first to fourth embodiments.
The information based on the user attribute information includes a time when it is determined that the first user related to the user attribute information is not continuously included in the image.
system.
本願の第6実施形態に係るシステムは、第1乃至5のいずれか一の実施形態に係るシステムにおいて、
前記利用者属性情報に基づく情報は、前記第1利用者の状況を示す情報を含む、
システム。 The system according to the sixth embodiment of the present application is the system according to any one of the first to fifth embodiments.
The information based on the user attribute information includes information indicating the situation of the first user.
system.
前記利用者属性情報に基づく情報は、前記第1利用者の状況を示す情報を含む、
システム。 The system according to the sixth embodiment of the present application is the system according to any one of the first to fifth embodiments.
The information based on the user attribute information includes information indicating the situation of the first user.
system.
本願の第7実施形態に係るシステムは、第1乃至6のいずれか一の実施形態に係るシステムにおいて、
前記第1利用者の状況を示す情報は、前記第1利用者が集中している状況を示す情報、前記第1利用者が会議中であることを示す情報、及び/又は、前記第1利用者がいる位置情報、を含む、
システム。 The system according to the seventh embodiment of the present application is the system according to any one of the first to sixth embodiments.
The information indicating the situation of the first user is information indicating a situation in which the first user is concentrated, information indicating that the first user is in a meeting, and / or the first use. Including location information, where there is a person,
system.
前記第1利用者の状況を示す情報は、前記第1利用者が集中している状況を示す情報、前記第1利用者が会議中であることを示す情報、及び/又は、前記第1利用者がいる位置情報、を含む、
システム。 The system according to the seventh embodiment of the present application is the system according to any one of the first to sixth embodiments.
The information indicating the situation of the first user is information indicating a situation in which the first user is concentrated, information indicating that the first user is in a meeting, and / or the first use. Including location information, where there is a person,
system.
本願の第8実施形態に係るプログラムは、
システムを、
第1利用者に係る第1端末装置に対し、前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、送信可能な第1送信手段、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、取得可能な取得手段、
前記利用者属性情報に基づく情報を、前記第1端末装置とは異なる第2端末装置に送信可能な第2送信手段、
として動作させるためのプログラムであって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
プログラム。 The program according to the eighth embodiment of the present application is
The system,
A first transmission means capable of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device according to the first user.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. Information that can be obtained, including
A second transmission means capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device,
It is a program to operate as
The user attribute information includes information indicating the presence or absence of the first user in the image.
program.
システムを、
第1利用者に係る第1端末装置に対し、前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、送信可能な第1送信手段、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、取得可能な取得手段、
前記利用者属性情報に基づく情報を、前記第1端末装置とは異なる第2端末装置に送信可能な第2送信手段、
として動作させるためのプログラムであって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
プログラム。 The program according to the eighth embodiment of the present application is
The system,
A first transmission means capable of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device according to the first user.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. Information that can be obtained, including
A second transmission means capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device,
It is a program to operate as
The user attribute information includes information indicating the presence or absence of the first user in the image.
program.
本願の第9実施形態に係るプログラムは、第8の実施形態に係るプログラムにおいて、
前記システム内の演算装置が実行する、プログラム。 The program according to the ninth embodiment of the present application is the program according to the eighth embodiment.
A program executed by an arithmetic unit in the system.
前記システム内の演算装置が実行する、プログラム。 The program according to the ninth embodiment of the present application is the program according to the eighth embodiment.
A program executed by an arithmetic unit in the system.
本願の第10実施形態に係る方法は、
システムが、
第1利用者に係る第1端末装置に対し、前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、送信する第1送信ステップ、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、取得する取得ステップ、
前記利用者属性情報に基づく情報を、前記第1端末装置とは異なる第2端末装置に送信する第2送信ステップ、
を実行する方法であって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
方法。 The method according to the tenth embodiment of the present application is
the system,
A first transmission step of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device according to the first user.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. Get the information, including the get step,
A second transmission step of transmitting information based on the user attribute information to a second terminal device different from the first terminal device.
Is a way to do
The user attribute information includes information indicating the presence or absence of the first user in the image.
Method.
システムが、
第1利用者に係る第1端末装置に対し、前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、送信する第1送信ステップ、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、取得する取得ステップ、
前記利用者属性情報に基づく情報を、前記第1端末装置とは異なる第2端末装置に送信する第2送信ステップ、
を実行する方法であって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
方法。 The method according to the tenth embodiment of the present application is
the system,
A first transmission step of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device according to the first user.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. Get the information, including the get step,
A second transmission step of transmitting information based on the user attribute information to a second terminal device different from the first terminal device.
Is a way to do
The user attribute information includes information indicating the presence or absence of the first user in the image.
Method.
本願の第11実施形態に係る方法は、第10の実施形態に係る方法において、
前記システム内の演算装置が実行する、方法。 The method according to the eleventh embodiment of the present application is the method according to the tenth embodiment.
A method performed by an arithmetic unit in the system.
前記システム内の演算装置が実行する、方法。 The method according to the eleventh embodiment of the present application is the method according to the tenth embodiment.
A method performed by an arithmetic unit in the system.
本願の第12実施形態に係る装置は、
前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、取得可能な第1取得部、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、送信可能な送信部、
前記第1端末装置とは異なる第2端末装置に係る利用者属性情報に基づく情報を、取得可能な取得部、
を備える第1端末装置であって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
第1端末装置。 The apparatus according to the twelfth embodiment of the present application is
The first acquisition unit, which can acquire a program that can be executed on the WEB browser of the first terminal device,
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. A transmitter that can send information, including
An acquisition unit that can acquire information based on user attribute information related to a second terminal device different from the first terminal device.
It is a first terminal device provided with
The user attribute information includes information indicating the presence or absence of the first user in the image.
First terminal device.
前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、取得可能な第1取得部、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、送信可能な送信部、
前記第1端末装置とは異なる第2端末装置に係る利用者属性情報に基づく情報を、取得可能な取得部、
を備える第1端末装置であって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
第1端末装置。 The apparatus according to the twelfth embodiment of the present application is
The first acquisition unit, which can acquire a program that can be executed on the WEB browser of the first terminal device,
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. A transmitter that can send information, including
An acquisition unit that can acquire information based on user attribute information related to a second terminal device different from the first terminal device.
It is a first terminal device provided with
The user attribute information includes information indicating the presence or absence of the first user in the image.
First terminal device.
本願の第13実施形態に係る装置は、第12実施形態に係る装置において、
前記第1端末装置内の演算装置が実行する、第1端末装置。 The apparatus according to the thirteenth embodiment of the present application is the apparatus according to the twelfth embodiment.
A first terminal device executed by an arithmetic unit in the first terminal device.
前記第1端末装置内の演算装置が実行する、第1端末装置。 The apparatus according to the thirteenth embodiment of the present application is the apparatus according to the twelfth embodiment.
A first terminal device executed by an arithmetic unit in the first terminal device.
本願の第14実施形態に係るプログラムは、
第1端末装置を、
前記第1端末装置に係る撮像装置によって撮像された画像を取得する取得手段、
前記画像に対して、機械学習済み機能を適用して生成した、前記第1端末装置に係る利用者属性情報を含む情報を、管理装置に対して、送信する送信手段、
前記第1端末装置とは異なる第2端末装置に係る利用者属性情報に基づく情報を、取得する取得手段、
として動作させるための、前記第1端末装置のWEBブラウザ上で実行可能で、前記機械学習済み機能を有する、プログラムであって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
プログラム。 The program according to the 14th embodiment of the present application is
The first terminal device,
An acquisition means for acquiring an image captured by an image pickup device according to the first terminal device,
A transmission means for transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device.
An acquisition means for acquiring information based on user attribute information related to a second terminal device different from the first terminal device.
A program that can be executed on the WEB browser of the first terminal device and has the machine-learned function.
The user attribute information includes information indicating the presence or absence of the first user in the image.
program.
第1端末装置を、
前記第1端末装置に係る撮像装置によって撮像された画像を取得する取得手段、
前記画像に対して、機械学習済み機能を適用して生成した、前記第1端末装置に係る利用者属性情報を含む情報を、管理装置に対して、送信する送信手段、
前記第1端末装置とは異なる第2端末装置に係る利用者属性情報に基づく情報を、取得する取得手段、
として動作させるための、前記第1端末装置のWEBブラウザ上で実行可能で、前記機械学習済み機能を有する、プログラムであって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
プログラム。 The program according to the 14th embodiment of the present application is
The first terminal device,
An acquisition means for acquiring an image captured by an image pickup device according to the first terminal device,
A transmission means for transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device.
An acquisition means for acquiring information based on user attribute information related to a second terminal device different from the first terminal device.
A program that can be executed on the WEB browser of the first terminal device and has the machine-learned function.
The user attribute information includes information indicating the presence or absence of the first user in the image.
program.
本願の第15実施形態に係るプログラムは、第14実施形態に係るプログラムにおいて、
前記第1端末装置内の演算装置が実行する、プログラム。 The program according to the fifteenth embodiment of the present application is the program according to the fourteenth embodiment.
A program executed by the arithmetic unit in the first terminal device.
前記第1端末装置内の演算装置が実行する、プログラム。 The program according to the fifteenth embodiment of the present application is the program according to the fourteenth embodiment.
A program executed by the arithmetic unit in the first terminal device.
本願の第16実施形態に係る方法は、
機械学習済み機能を有し、WEBブラウザ上で実行可能な第1端末装置が、
前記第1端末装置に係る撮像装置によって撮像された画像を取得する取得ステップ、
前記画像に対して、機械学習済み機能を適用して生成した、前記第1端末装置に係る利用者属性情報を含む情報を、管理装置に対して、送信する送信ステップ、
前記第1端末装置とは異なる第2端末装置に係る利用者属性情報に基づく情報を、取得する取得ステップ、
を実行する方法であって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
方法。 The method according to the 16th embodiment of the present application is
The first terminal device that has machine-learned functions and can be executed on the WEB browser is
Acquisition step of acquiring an image captured by the image pickup device according to the first terminal device,
A transmission step of transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device.
An acquisition step of acquiring information based on user attribute information related to a second terminal device different from the first terminal device.
Is a way to do
The user attribute information includes information indicating the presence or absence of the first user in the image.
Method.
機械学習済み機能を有し、WEBブラウザ上で実行可能な第1端末装置が、
前記第1端末装置に係る撮像装置によって撮像された画像を取得する取得ステップ、
前記画像に対して、機械学習済み機能を適用して生成した、前記第1端末装置に係る利用者属性情報を含む情報を、管理装置に対して、送信する送信ステップ、
前記第1端末装置とは異なる第2端末装置に係る利用者属性情報に基づく情報を、取得する取得ステップ、
を実行する方法であって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
方法。 The method according to the 16th embodiment of the present application is
The first terminal device that has machine-learned functions and can be executed on the WEB browser is
Acquisition step of acquiring an image captured by the image pickup device according to the first terminal device,
A transmission step of transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device.
An acquisition step of acquiring information based on user attribute information related to a second terminal device different from the first terminal device.
Is a way to do
The user attribute information includes information indicating the presence or absence of the first user in the image.
Method.
本願の第17実施形態に係る方法は、第16実施形態に係る方法において、
前記第1端末装置内の演算装置が実行する、方法。 The method according to the 17th embodiment of the present application is the method according to the 16th embodiment.
A method executed by an arithmetic unit in the first terminal device.
前記第1端末装置内の演算装置が実行する、方法。 The method according to the 17th embodiment of the present application is the method according to the 16th embodiment.
A method executed by an arithmetic unit in the first terminal device.
本発明の一実施形態により、より適切にコミュニケーションの機会を増加できる。
According to one embodiment of the present invention, opportunities for communication can be increased more appropriately.
1.発明の概要
本願発明に係る一実施形態のシステムは、一定のプライバシーの保護のもと、情報処理装置を利用する各利用者の状況を、互いに伝達し、状況に応じたコミュニケーションの向上を促進する技術に係る。本願書類において、「システム」という用語は、一又は複数の情報処理装置から構成されてよい。例えば、一実施形態のシステムは、後述する、一又は複数の端末装置であってもよいし、一又は複数の管理装置であってもよいし、一又は複数の端末装置及び一又は複数の管理装置であってもよい。一実施形態のシステムは、例えば、図1である。利用者端末011乃至015と、管理装置001、002と、が各々、接続可能とされていてよい。ここで、管理装置は、1台でもよいし、複数台でもよい。また、管理装置001、002には、各々、管理端末001a、002aが、各々接続されていてよい。管理装置は、一又は複数の管理端末が接続されていてよい。 1. 1. Outline of the Invention The system of the embodiment according to the present invention communicates the situation of each user who uses the information processing device with each other and promotes the improvement of communication according to the situation under the protection of a certain degree of privacy. Related to technology. In the documents of the present application, the term "system" may be composed of one or more information processing devices. For example, the system of one embodiment may be one or more terminal devices, one or more management devices, or one or more terminal devices and one or more management devices, which will be described later. It may be a device. The system of one embodiment is, for example, FIG. Theuser terminals 011 to 015 and the management devices 001 and 002 may be connected to each other. Here, the number of management devices may be one or a plurality. Further, the management terminals 001a and 002a may be connected to the management devices 001 and 002, respectively. The management device may be connected to one or more management terminals.
本願発明に係る一実施形態のシステムは、一定のプライバシーの保護のもと、情報処理装置を利用する各利用者の状況を、互いに伝達し、状況に応じたコミュニケーションの向上を促進する技術に係る。本願書類において、「システム」という用語は、一又は複数の情報処理装置から構成されてよい。例えば、一実施形態のシステムは、後述する、一又は複数の端末装置であってもよいし、一又は複数の管理装置であってもよいし、一又は複数の端末装置及び一又は複数の管理装置であってもよい。一実施形態のシステムは、例えば、図1である。利用者端末011乃至015と、管理装置001、002と、が各々、接続可能とされていてよい。ここで、管理装置は、1台でもよいし、複数台でもよい。また、管理装置001、002には、各々、管理端末001a、002aが、各々接続されていてよい。管理装置は、一又は複数の管理端末が接続されていてよい。 1. 1. Outline of the Invention The system of the embodiment according to the present invention communicates the situation of each user who uses the information processing device with each other and promotes the improvement of communication according to the situation under the protection of a certain degree of privacy. Related to technology. In the documents of the present application, the term "system" may be composed of one or more information processing devices. For example, the system of one embodiment may be one or more terminal devices, one or more management devices, or one or more terminal devices and one or more management devices, which will be described later. It may be a device. The system of one embodiment is, for example, FIG. The
2.一実施形態に係るシステムの機能
一例のシステムは、画像を取得し、情報を表示する、複数の端末装置と、複数の端末装置から得た情報を取得して、情報処理して、複数の端末装置に送信する管理システムと、を備えてよい。以下、端末装置側の機能と、管理装置側の機能と、を分けて説明する。なお、本願書類において、端末装置を利用する者を「利用者」といい、管理装置を用いる者を「管理者」という。 2. 2. Functions of the system according to one embodiment In the system of one example, a plurality of terminal devices that acquire images and display information, and a plurality of terminals that acquire information obtained from a plurality of terminal devices, process information, and perform information processing. It may be equipped with a management system for transmitting to the device. Hereinafter, the function on the terminal device side and the function on the management device side will be described separately. In the documents of the present application, a person who uses the terminal device is referred to as a "user", and a person who uses the management device is referred to as an "administrator".
一例のシステムは、画像を取得し、情報を表示する、複数の端末装置と、複数の端末装置から得た情報を取得して、情報処理して、複数の端末装置に送信する管理システムと、を備えてよい。以下、端末装置側の機能と、管理装置側の機能と、を分けて説明する。なお、本願書類において、端末装置を利用する者を「利用者」といい、管理装置を用いる者を「管理者」という。 2. 2. Functions of the system according to one embodiment In the system of one example, a plurality of terminal devices that acquire images and display information, and a plurality of terminals that acquire information obtained from a plurality of terminal devices, process information, and perform information processing. It may be equipped with a management system for transmitting to the device. Hereinafter, the function on the terminal device side and the function on the management device side will be described separately. In the documents of the present application, a person who uses the terminal device is referred to as a "user", and a person who uses the management device is referred to as an "administrator".
2.1.端末装置内の機能
本願発明に係る一実施形態は、端末装置内の機能として、情報生成する情報生成部と、情報送信部と、情報表示部と、を備える。 2.1. Functions in a Terminal Device An embodiment according to the present invention includes an information generation unit for generating information, an information transmission unit, and an information display unit as functions in the terminal device.
本願発明に係る一実施形態は、端末装置内の機能として、情報生成する情報生成部と、情報送信部と、情報表示部と、を備える。 2.1. Functions in a Terminal Device An embodiment according to the present invention includes an information generation unit for generating information, an information transmission unit, and an information display unit as functions in the terminal device.
本願発明に係る一実施形態は、端末装置内で実行されるソフトウェアであってよい。また、本願発明に係る一実施形態は、端末装置内のWEBブラウザ上で実行されるソフトウェアであってもよいし、端末装置にダウンロードされて端末装置にインストールされるソフトウェアであってもよい。
One embodiment according to the present invention may be software executed in a terminal device. Further, one embodiment according to the present invention may be software executed on a WEB browser in the terminal device, or may be software downloaded to the terminal device and installed in the terminal device.
端末装置内のWEBブラウザ上で実行されるソフトウェアの場合、ソフトウェアの開発負担が軽減できる利点がある。すなわち、情報処理装置の黎明期には個々人が利用する情報処理装置は画一的で同じものであることから個々人の利用する情報処理装置内にインストールされるソフトウェアを開発することの負担は大きくなかった。しかしながら、現代のように、デスクトップパソコン、ノートパソコン、スマートフォン、タブレット、など多様な情報処理装置と、各情報処理装置について、更に、OSが異なったり、バージョンが異なったりと、各々が複雑に多様化され、また、個々人や各企業もその目的とする業務に適した情報処理装置を選択するなどにより、業務に携わる人が利用する情報処理装置の種類は多様になっていることから、これらの多様な情報処理装置に合わせたソフトウェアを開発することの負担は大きい。そこで、上述のWEBブラウザ上で実行されるソフトウェアは、WEBブラウザ内で実行可能なソフトウェアとし、個々の情報処理装置の差異は個々の情報処理装置がインストール済みのWEBブラウザによって吸収させて、WEBブラウザの種類やバージョンのみに対応したソフトウェアとして、提供してよい。この場合、個々の情報処理装置にインストール可能なソフトウェアを作成することよりも、遥かに、ソフトウェアの作成負担が減少する利点がある。
In the case of software executed on the WEB browser in the terminal device, there is an advantage that the software development burden can be reduced. In other words, in the early days of information processing equipment, the information processing equipment used by each individual is uniform and the same, so the burden of developing software installed in the information processing equipment used by each individual is not great. rice field. However, as in modern times, various information processing devices such as desktop computers, laptop computers, smartphones, tablets, etc., and each information processing device are complicatedly diversified with different OSs and different versions. In addition, the types of information processing equipment used by people involved in business are diversifying due to the selection of information processing equipment suitable for the intended business by individuals and companies. The burden of developing software tailored to various information processing devices is heavy. Therefore, the software executed on the above-mentioned WEB browser is software that can be executed in the WEB browser, and the difference between the individual information processing devices is absorbed by the WEB browser installed in each information processing device, and the WEB browser is used. It may be provided as software corresponding only to the type and version of. In this case, there is an advantage that the burden of creating software is much reduced as compared with creating software that can be installed in each information processing device.
他方、本願発明に係る一実施形態のソフトウェアは、端末装置にインストールされるものでもよい。この場合、各情報処理装置内での実行に最適化されたソフトウェアを作成することができ、その場合、実行速度を速め、本願発明に係る機能の実行において、個々の情報処理装置のメモリやCPUの利用率を低下できる利点がある。
On the other hand, the software of one embodiment according to the present invention may be installed in a terminal device. In this case, it is possible to create software optimized for execution in each information processing device, in which case the execution speed is increased and the memory and CPU of each information processing device are executed in the execution of the function according to the present invention. There is an advantage that the utilization rate of can be reduced.
なお、端末装置は、ノートパソコン、タブレットPC、スマートフォン、携帯電話、などの利用者が業務において使用されうる携帯端末装置であってもよいし、デスクトップパソコン、などでもよく、情報処理装置であればよい。
The terminal device may be a portable terminal device such as a notebook personal computer, a tablet PC, a smartphone, a mobile phone, etc. that can be used in business by a user, a desktop personal computer, or the like, as long as it is an information processing device. good.
2.1.1.情報生成部211
情報生成部は、情報を生成する機能を有する。より具体的には、情報生成部は、画像から、利用者属性情報を生成する機能を有する。ここで、利用者属性情報という用語は、利用者を利用者端末に係る撮像装置によってリアルタイムに撮像されることで得られる静止画や動画などの画像を含まない。後述の通り、端末装置は、利用者属性情報に基づく情報を、管理装置に送信するが、かかるリアルタイムの利用者に係る画像自体を含まないことにより、端末装置を利用する利用者のリアルタイムのプライバシーを保護できる利点がある。なお、利用者属性情報の用語の下位概念として、「利用者静的属性情報」と、「利用者動的属性情報」と、があってよく、情報生成部が生成する利用者属性情報は、利用者動的属性情報として扱われてよい。 2.1.1. Information generation unit 211
The information generation unit has a function of generating information. More specifically, the information generation unit has a function of generating user attribute information from an image. Here, the term user attribute information does not include images such as still images and moving images obtained by capturing a user in real time by an image pickup device related to a user terminal. As will be described later, the terminal device transmits information based on the user attribute information to the management device, but by not including the image itself related to the real-time user, the real-time privacy of the user who uses the terminal device. Has the advantage of being able to protect. In addition, as a subordinate concept of the term of user attribute information, there may be "user static attribute information" and "user dynamic attribute information", and the user attribute information generated by the information generation unit is It may be treated as user dynamic attribute information.
情報生成部は、情報を生成する機能を有する。より具体的には、情報生成部は、画像から、利用者属性情報を生成する機能を有する。ここで、利用者属性情報という用語は、利用者を利用者端末に係る撮像装置によってリアルタイムに撮像されることで得られる静止画や動画などの画像を含まない。後述の通り、端末装置は、利用者属性情報に基づく情報を、管理装置に送信するが、かかるリアルタイムの利用者に係る画像自体を含まないことにより、端末装置を利用する利用者のリアルタイムのプライバシーを保護できる利点がある。なお、利用者属性情報の用語の下位概念として、「利用者静的属性情報」と、「利用者動的属性情報」と、があってよく、情報生成部が生成する利用者属性情報は、利用者動的属性情報として扱われてよい。 2.1.1. Information generation unit 211
The information generation unit has a function of generating information. More specifically, the information generation unit has a function of generating user attribute information from an image. Here, the term user attribute information does not include images such as still images and moving images obtained by capturing a user in real time by an image pickup device related to a user terminal. As will be described later, the terminal device transmits information based on the user attribute information to the management device, but by not including the image itself related to the real-time user, the real-time privacy of the user who uses the terminal device. Has the advantage of being able to protect. In addition, as a subordinate concept of the term of user attribute information, there may be "user static attribute information" and "user dynamic attribute information", and the user attribute information generated by the information generation unit is It may be treated as user dynamic attribute information.
端末装置において、撮像装置を介して取得された、利用者の顔の静止画や顔の動画は、氏名や住所などと比べて、より直接人自身を示す高度にプライベートな情報であり、かかる顔の静止画や顔の動画のような顔の画像がネットワークを介して常時伝達されることは、人々の精神的負担を増加させることになると、発明者らは考えた。また、同様に、在宅勤務である場合、端末装置において、撮像装置を介して得られた画像は、人々の住居内の画像であり、極めてプライベートな画像であることから、かかる画像が、ネットワークを介して常時伝達されることも、勤務時間といえども同様に、人々の精神的負担を増加させることになると、発明者らは考えた。
In the terminal device, the still image of the user's face and the moving image of the face acquired through the image pickup device are highly private information indicating the person himself / herself more directly than the name and address, and such a face. The inventors thought that the constant transmission of facial images, such as still images and moving images of the face, via the network would increase the mental burden on people. Similarly, in the case of working from home, in the terminal device, the image obtained through the image pickup device is an image in a person's residence and is an extremely private image. The inventors thought that constant communication through the system would increase the mental burden on people as well as working hours.
また、静止画や動画を、ネットワークを介して伝達しないことにより、ネットワークの伝達の負担を減少できる利点がある。すなわち、通信技術の向上と普及により、在宅勤務が想定される各家庭においても、高速なネットワークが提供されつつある現代であるが、それでも、常時、特に動画を、ネットワーク上伝達させることは、ネットワークの負担を増加させる。
In addition, there is an advantage that the burden of network transmission can be reduced by not transmitting still images and moving images via the network. In other words, due to the improvement and widespread use of communication technology, high-speed networks are being provided even in households that are expected to work from home. Increase the burden of.
特に、近年は、セキュリティ意識の向上により、端末装置内に重要なデータを格納せず、管理サーバやクラウドにデータを格納するケースが多い。その場合、各端末装置は、業務中、常に、これらの管理サーバやクラウド内のデータに、アクセスする必要があることも多い。このような時代背景を踏まえると、コミュニケーションのための技術においては、各家庭のネットワークの通信負担を増加させないことも極めて重要であるところ、本願発明において、画像を利用しないことで、ネットワークの負担を増加させる必要がない利点がある。
Especially in recent years, due to the improvement of security awareness, there are many cases where important data is not stored in the terminal device but stored in the management server or cloud. In that case, each terminal device often needs to access the data in these management servers and the cloud at all times during business. In light of this historical background, it is extremely important not to increase the communication load of the network of each home in the technology for communication. However, in the present invention, the burden on the network is increased by not using the image. There is an advantage that it does not need to be increased.
このように、本願発明に係る一実施形態においては、端末装置から管理装置に画像を伝送せず、画像から生成された情報を、端末装置から管理装置に伝送するために、画像から情報を生成する機能を端末装置上で実行するよう構成する。
As described above, in the embodiment according to the present invention, the information generated from the image is generated from the image in order to transmit the information generated from the image from the terminal device to the management device without transmitting the image from the terminal device to the management device. It is configured to execute the function to be performed on the terminal device.
情報生成部が有する画像を取得する機能は、端末装置に関連付けられた撮像装置を用いてよい。端末装置に関連付けられた撮像装置は、端末装置内に備えれた撮像装置でもよいし、端末装置の外部において端末装置と接続された撮像装置でもよい。撮像装置は、撮像機能によって画像を取得できればよく、WEBカメラや携帯端末カメラ、等であってもよい。なお、本願書類において、画像は、静止画であってもよいし、動画であってもよく、画像という用語を、静止画及び動画の上位概念の用語として使用する。
The image acquisition device associated with the terminal device may be used for the function of acquiring the image possessed by the information generation unit. The image pickup device associated with the terminal device may be an image pickup device provided inside the terminal device, or may be an image pickup device connected to the terminal device outside the terminal device. The image pickup device may be a WEB camera, a portable terminal camera, or the like, as long as the image can be acquired by the image pickup function. In the document of the present application, the image may be a still image or a moving image, and the term image is used as a term of a superordinate concept of the still image and the moving image.
情報生成部は、取得した画像から、利用者属性情報を取得してよい。情報生成部は、画像と利用者属性情報との関係を機械学習した機械学習済み機能を有してよい。情報生成部は、新たに撮像して取得された画像に対して、かかる機械学習済み機能を用いて、対応する画像情報を生成してよい。
The information generation unit may acquire user attribute information from the acquired image. The information generation unit may have a machine-learned function in which the relationship between the image and the user attribute information is machine-learned. The information generation unit may generate the corresponding image information for the newly captured and acquired image by using the machine-learned function.
また、情報生成部における、上述の機械学習済み機能は、機械学習済みモデルの機能で実現されてもよい。機械学習済みモデルは、画像と利用者属性情報との関係を機械学習した機械学習済み機能を実行可能なモデルであってよく、新たに撮像して取得された画像に対して、対応する利用者属性情報を生成できるものであってよい。また、機械学習済みモデルは、情報処理装置内のCPU及びメモリを利用して実行可能なソフトウェアであってよい。
Further, the above-mentioned machine-learned function in the information generation unit may be realized by the function of the machine-learned model. The machine-learned model may be a model that can execute a machine-learned function that machine-learns the relationship between the image and the user attribute information, and the corresponding user corresponds to the newly captured image. It may be something that can generate attribute information. Further, the machine-learned model may be software that can be executed by using the CPU and the memory in the information processing apparatus.
利用者属性情報は、撮像した画像内に、人の顔の有無を示す情報を含んでよい。この場合、一実施形態に係る機械学習済み機能は、画像と、画像内の人の有無と、の関係を機械学習済みであり、新たな画像に対して、画像内の人の有無を示す情報を生成できてよい。なお、この場合、一実施形態に係る機械学習済み機能は、画像内に人の顔が一つある場合のみ、画像内に人の顔があることを示す情報を生成してもよいし、画像内に人の顔が一つ以上ある場合は、画像内に人の顔があることを示す情報を生成してもよい。
The user attribute information may include information indicating the presence or absence of a human face in the captured image. In this case, the machine-learned function according to one embodiment has machine-learned the relationship between the image and the presence / absence of a person in the image, and information indicating the presence / absence of a person in the image for a new image. May be able to generate. In this case, the machine-learned function according to the embodiment may generate information indicating that there is a human face in the image only when there is one human face in the image, or the image. If there is one or more human faces inside, information indicating that there is a human face in the image may be generated.
なお、情報生成部は、取得された撮像した画像内に、人の顔が複数検出された場合、画面の覗き込みのアラートを出してもよい。具体的には、第1端末装置内のWEBブラウザ上で実行されているプログラム内の情報生成部が、取得された画像内に、複数の人の顔を検出した場合、かかる第1端末装置内のWEBブラウザ上で実行されているプログラム内の後述の表示生成部は、画面の覗き込みを第1端末装置に係る利用者が気づくようにアラートを出してよい。
Note that the information generation unit may issue an alert for looking into the screen when a plurality of human faces are detected in the acquired image. Specifically, when the information generation unit in the program executed on the WEB browser in the first terminal device detects the faces of a plurality of people in the acquired image, the inside of the first terminal device. The display generation unit, which will be described later in the program executed on the WEB browser of the above, may issue an alert so that the user related to the first terminal device notices the peek at the screen.
また、第1端末装置内のWEBブラウザ上で実行されているプログラム内の情報生成部の有する機械学習部は、取得された撮像した画像内の複数の人の顔の視線の方向を用いて、複数の人による画面の覗き込みの有無を検出し、複数の人による画面の覗き込みがあることを検出した場合、かかる第1端末装置内のWEBブラウザ上で実行されているプログラム内の後述の表示生成部は、画面の覗き込みを第1端末装置に係る利用者が気づくようにアラートを出してよい。かかる機械学習部は、例えば、画像と、人の顔に係る視線の方向と、の関係を機械学習したものであってよく、新たな画像に対して、画像内の人の視線の方向を特定できるものであってよい。また、かかる機械学習部は、例えば、画像と、人の顔に係る視線の方向が略画面の方向であるかどうかと、の関係を機械学習したものであってよく、新たな画像に対して、画像内の人の視線の方向が略画面の方向であるかどうかを特定できるものであってよい。なお、かかる略画面の方向であるかどうかは、かかる画像を撮像した撮像装置の方向であってもよいし、かかる画像を撮像した撮像装置と画面との位置のずれを考慮した画面の方向であってもよい。
Further, the machine learning unit of the information generation unit in the program executed on the WEB browser in the first terminal device uses the directions of the lines of sight of the faces of a plurality of people in the acquired captured image. When it is detected that the screen is viewed by a plurality of people and the screen is viewed by a plurality of people, it will be described later in the program executed on the WEB browser in the first terminal device. The display generation unit may issue an alert so that the user related to the first terminal device notices the peek at the screen. Such a machine learning unit may be, for example, machine-learned about the relationship between an image and the direction of the line of sight of a person's face, and specifies the direction of the person's line of sight in the image for a new image. It may be something that can be done. Further, the machine learning unit may be machine-learned about the relationship between the image and whether or not the direction of the line of sight of the human face is substantially the direction of the screen, and the machine learning unit may be used for a new image. , It may be possible to specify whether or not the direction of the line of sight of a person in the image is substantially the direction of the screen. It should be noted that whether or not the direction of the screen is substantially the direction of the screen may be the direction of the image pickup device that has captured the image, or the direction of the screen in consideration of the positional deviation between the image pickup device that has captured the image and the screen. There may be.
利用者が気づくようなアラートの態様は、種々のものであってよい。例えば、WEBブラウザ全体または一部に、「覗き込み検出」などのような表現がされてもよいし、「アラート」などのような表現がされてもよい。ブラウザ内全体に表示がされた場合、利用者は、直に気が付くことができる利点がある。また、ブラウザ内の一部であっても、予め表示箇所が規定されている場合には、利用者が気づくことができる利点がある。また、かかるアラートは、第三者は知らなければ分からない態様であり、本実施形態に係るシステムのマニュアルで説明された利用者のみが理解可能な態様の表現であってもよい。この場合、利用者のみが覗き込みに気づくことができ、かかる覗き込みをさりげなく防止できる機会を利用者に与える利点がある。また、かかるアラートは、表示のみならず、又は、表示に代えて、音を発してもよい。この場合、音によって、より利用者は覗き込みに気づくことができる利点がある。
The mode of the alert that the user notices may be various. For example, the whole or a part of the WEB browser may be expressed as "peeping detection" or "alert". There is an advantage that the user can immediately notice when the display is displayed in the entire browser. Further, even if it is a part of the browser, if the display location is specified in advance, there is an advantage that the user can notice it. Further, the alert may be an expression that cannot be understood by a third party without knowing it, and may be an expression that can be understood only by the user described in the manual of the system according to the present embodiment. In this case, only the user can notice the peeping, and there is an advantage that the user is given an opportunity to casually prevent such peeping. Further, such an alert may not only be displayed, or may emit a sound instead of the display. In this case, the sound has the advantage that the user can be more aware of the peeping.
また、情報生成部が検出してからリアルタイムに、情報表示部が、かかるアラートを表示してよい。
Further, the information display unit may display such an alert in real time after the information generation unit detects it.
また、上述のアラートが生成された場合、かかるアラートが生成されたことを、情報送信部を介して、管理装置に伝達されてもよい。管理装置は、かかるアラートについて、利用者と関連付けて、記憶してよい。この場合、管理装置は、各利用者のアラートの生成の所定期間内の合計数、所定期間内の平均数、などについて、統計情報を生成し、管理者端末に送信して管理者端末において表示可能としてよい。この場合、管理者端末に係る管理者は、利用者が、どの程度覗き込みがされているのかについての情報を取得し、利用者の就業環境に対するアドバイスをする機会を得ることができる利点がある。
Further, when the above-mentioned alert is generated, the fact that such an alert is generated may be transmitted to the management device via the information transmission unit. The management device may associate and store such alerts with the user. In this case, the management device generates statistical information about the total number of alerts generated by each user within a predetermined period, the average number within a predetermined period, etc., sends it to the administrator terminal, and displays it on the administrator terminal. It may be possible. In this case, the administrator related to the administrator terminal has an advantage that the user can obtain information on how much he / she is looking into and have an opportunity to give advice on the user's working environment. ..
また、利用者属性情報は、撮像した画像内に、予め登録された利用者の顔に係る情報が用いられて認証された利用者の顔の有無を示す情報を含んでよい。この場合、一実施形態に係る機械学習済み機能は、画像と、画像内の人の顔を示す情報と、の関係を機械学習済みであり、新たな画像に対して、画像内の人の顔を示す情報を生成した上で、情報生成部は、かかる人の顔を示す情報が、予め登録された利用者の顔であるかを判定することで、予め登録された利用者の顔の有無を生成してよい。また、かかる構成に代えて、又は、かかる構成に加えて、一実施形態に係る機械学習済み機能は、画像と、画像内の予め登録された利用者の顔の有無を示す情報と、の関係を機械学習済みであり、新たな画像に対して、画像内に予め登録された利用者の顔の有無を示す情報を生成してもよい。なお、この場合、一実施形態に係る機械学習済み機能は、画像内に利用者の顔がない場合は常に利用者の顔がないことを示す情報を生成してもよいし、画像内に利用者の顔がなくかつ他に人の顔がない場合に限り利用者の顔がないことを示す情報を生成してもよい。なお、認証に用いられる予め登録された利用者の顔についての情報は、WEBブラウザ上で実行されるプログラムが利用可能な端末装置内のキャッシュに記憶され、かかる端末装置内のキャッシュ内の予め登録された利用者の顔と、撮像した画像内の人の顔と、が照合されてよい。この場合、登録された利用者の顔についての情報が、端末装置内にとどまり、管理装置に送信されないため、プライバシーが保護される利点がある。なお、上述の態様に代えて、認証に用いられる予め登録された利用者の顔を一意的に識別可能な特徴情報は、端末装置から管理装置に送信され、管理装置内に利用者のIDなどと関連付けられて記憶されてよく、この場合、撮像した画像内の人の顔に対する特徴情報が、端末装置から管理装置に送信されて、管理装置内で照合されてもよい。この場合、端末装置内の情報が削除されたり、通常とは異なる端末装置を利用者のIDを用いてログインした場合においても、同様に認証できる利点がある。
Further, the user attribute information may include information indicating the presence or absence of a user's face that has been authenticated by using the information related to the user's face registered in advance in the captured image. In this case, the machine-learned function according to the embodiment has machine-learned the relationship between the image and the information indicating the face of the person in the image, and the face of the person in the image is obtained with respect to the new image. After generating the information indicating the above, the information generation unit determines whether the information indicating the face of the person is the face of the pre-registered user, so that the presence or absence of the face of the pre-registered user is present. May be generated. Further, instead of or in addition to such a configuration, the machine-learned function according to the embodiment is a relationship between an image and information indicating the presence or absence of a pre-registered user's face in the image. Has been machine-learned, and information indicating the presence or absence of a user's face registered in advance in the image may be generated for a new image. In this case, the machine-learned function according to the embodiment may generate information indicating that there is no user's face whenever there is no user's face in the image, or may be used in the image. Information indicating that there is no user's face may be generated only when there is no person's face and there is no other person's face. Information about the pre-registered user's face used for authentication is stored in a cache in a terminal device in which a program executed on the WEB browser can be used, and is pre-registered in the cache in the terminal device. The face of the user and the face of the person in the captured image may be collated. In this case, since the information about the registered user's face stays in the terminal device and is not transmitted to the management device, there is an advantage that privacy is protected. Instead of the above-described aspect, the feature information that can uniquely identify the user's face used for authentication is transmitted from the terminal device to the management device, and the user's ID or the like is transmitted to the management device. In this case, the feature information for the human face in the captured image may be transmitted from the terminal device to the management device and collated in the management device. In this case, even if the information in the terminal device is deleted or a terminal device different from the usual one is logged in using the user's ID, there is an advantage that the authentication can be performed in the same manner.
また、情報生成部は、取得された撮像した画像内に、予め登録された利用者の顔と異なる顔が検出された場合、画面の覗き込みのアラートを出してもよい。具体的には、第1端末装置内のWEBブラウザ上で実行されているプログラム内の情報生成部が、取得された画像内に、予め登録された利用者の顔と異なる顔を検出した場合、かかる第1端末装置内のWEBブラウザ上で実行されているプログラム内の後述の表示生成部は、画面の覗き込みを第1端末装置に係る利用者が気づくようにアラートを出してよい。
Further, the information generation unit may issue an alert for looking into the screen when a face different from the face of the user registered in advance is detected in the acquired image. Specifically, when the information generation unit in the program executed on the WEB browser in the first terminal device detects a face different from the user's face registered in advance in the acquired image, The display generation unit described later in the program executed on the WEB browser in the first terminal device may issue an alert so that the user related to the first terminal device notices the screen peeping.
また、第1端末装置内のWEBブラウザ上で実行されているプログラム内の情報生成部の有する機械学習部は、取得された撮像した画像内の予め登録された利用者の顔と異なる顔の視線の方向を用いて、予め登録された利用者の顔と異なる顔による画面の覗き込みの有無を検出し、予め登録された利用者の顔と異なる顔による画面の覗き込みがあることを検出した場合、かかる第1端末装置内のWEBブラウザ上で実行されているプログラム内の後述の表示生成部は、画面の覗き込みを第1端末装置に係る利用者が気づくようにアラートを出してよい。かかる機械学習部は、例えば、上述の認証についての判定に加えて、画像と、人の顔に係る視線の方向と、の関係を機械学習したものであってよく、新たな画像に対して、画像内の人の視線の方向を特定できるものであってよい。また、かかる機械学習部は、例えば、画像と、人の顔に係る視線の方向が略画面の方向であるかどうかと、の関係を機械学習したものであってよく、新たな画像に対して、画像内の人の視線の方向が略画面の方向であるかどうかを特定できるものであってよい。なお、かかる略画面の方向であるかどうかは、かかる画像を撮像した撮像装置の方向であってもよいし、かかる画像を撮像した撮像装置と画面との位置のずれを考慮した画面の方向であってもよい。
Further, the machine learning unit of the information generation unit in the program executed on the WEB browser in the first terminal device has a line of sight different from the user's face registered in advance in the acquired captured image. Using the direction of, it was detected whether or not the screen was peeped by a face different from the pre-registered user's face, and it was detected that the screen was peeped by a face different from the pre-registered user's face. In this case, the display generation unit described later in the program executed on the WEB browser in the first terminal device may issue an alert so that the user related to the first terminal device notices the screen peeping. For example, in addition to the determination for the above-mentioned authentication, the machine learning unit may be machine-learned about the relationship between the image and the direction of the line of sight related to the human face, and may be machine-learned for a new image. It may be able to specify the direction of the line of sight of a person in the image. Further, the machine learning unit may be machine-learned about the relationship between the image and whether or not the direction of the line of sight of the human face is substantially the direction of the screen, and the machine learning unit may be used for a new image. , It may be possible to specify whether or not the direction of the line of sight of a person in the image is substantially the direction of the screen. It should be noted that whether or not the direction of the screen is substantially the direction of the screen may be the direction of the image pickup device that has captured the image, or the direction of the screen in consideration of the positional deviation between the image pickup device that has captured the image and the screen. There may be.
利用者が気づくようなアラートの態様は、種々のものであってよい。例えば、WEBブラウザ全体または一部に、「覗き込み検出」などのような表現がされてもよいし、「アラート」などのような表現がされてもよい。ブラウザ内全体に表示がされた場合、利用者は、直に気が付くことができる利点がある。また、ブラウザ内の一部であっても、予め表示箇所が規定されている場合には、利用者が気づくことができる利点がある。また、かかるアラートは、第三者は知らなければ分からない態様であり、本実施形態に係るシステムのマニュアルで説明された利用者のみが理解可能な態様の表現であってもよい。この場合、利用者のみが覗き込みに気づくことができ、かかる覗き込みをさりげなく防止できる機会を利用者に与える利点がある。また、かかるアラートは、表示のみならず、又は、表示に代えて、音を発してもよい。この場合、音によって、より利用者は覗き込みに気づくことができる利点がある。
The mode of the alert that the user notices may be various. For example, the whole or a part of the WEB browser may be expressed as "peeping detection" or "alert". There is an advantage that the user can immediately notice when the display is displayed in the entire browser. Further, even if it is a part of the browser, if the display location is specified in advance, there is an advantage that the user can notice it. Further, the alert may be an expression that cannot be understood by a third party without knowing it, and may be an expression that can be understood only by the user described in the manual of the system according to the present embodiment. In this case, only the user can notice the peeping, and there is an advantage that the user is given an opportunity to casually prevent such peeping. Further, such an alert may not only be displayed, or may emit a sound instead of the display. In this case, the sound has the advantage that the user can be more aware of the peeping.
また、情報生成部が検出してからリアルタイムに、情報表示部が、かかるアラートを表示してよい。
Further, the information display unit may display such an alert in real time after the information generation unit detects it.
また、上述のアラートが生成された場合、かかるアラートが生成されたことを、情報送信部を介して、管理装置に伝達されてもよい。管理装置は、かかるアラートについて、利用者と関連付けて、記憶してよい。この場合、管理装置は、各利用者のアラートの生成の所定期間内の合計数、所定期間内の平均数、などについて、統計情報を生成し、管理者端末に送信して管理者端末において表示可能としてよい。この場合、管理者端末に係る管理者は、利用者が、どの程度覗き込みがされているのかについての情報を取得し、利用者の就業環境に対するアドバイスをする機会を得ることができる利点がある。
Further, when the above-mentioned alert is generated, the fact that such an alert is generated may be transmitted to the management device via the information transmission unit. The management device may associate and store such alerts with the user. In this case, the management device generates statistical information about the total number of alerts generated by each user within a predetermined period, the average number within a predetermined period, etc., sends it to the administrator terminal, and displays it on the administrator terminal. It may be possible. In this case, the administrator related to the administrator terminal has an advantage that the user can obtain information on how much he / she is looking into and have an opportunity to give advice on the user's working environment. ..
また、上述のアラートが生成された場合、情報送信部は、かかる予め登録された利用者の顔と異なる顔を、管理装置に送信し、更に、管理者端末に送信し、管理者端末において表示可能とさせてもよい。また、かかる利用者端末において、かかる予め登録された利用者の顔と異なる顔が画面内に検出された、所定期間の合計数、所定期間の平均値、などの統計情報のみ、又は、かかる予め登録された利用者の顔と異なる顔と合わせて、管理者端末に送信し、管理者端末において表示可能とさせてもよい。
Further, when the above-mentioned alert is generated, the information transmission unit sends a face different from the face of the user registered in advance to the management device, further sends it to the administrator terminal, and displays it on the administrator terminal. It may be possible. Further, on the user terminal, only statistical information such as the total number of predetermined periods, the average value of the predetermined period, etc., in which a face different from the face of the pre-registered user is detected on the screen, or in advance. A face different from the registered user's face may be transmitted to the administrator terminal so that the face can be displayed on the administrator terminal.
また、利用者属性情報は、人の顔が継続して画像内にある継続時間、を含んでよい。かかる継続時間は、情報生成部が、画像内に人の顔がないという情報の後に画像内に人の顔があるという情報が生成された時点を開始時点として、継続して、画像内に人の顔があるという情報が生成されている場合の経過時間の情報を用いて、生成されてよい。
Further, the user attribute information may include the duration during which the human face is continuously in the image. The duration is continued from the time when the information generation unit generates the information that there is a human face in the image after the information that there is no human face in the image, and continues to be the person in the image. It may be generated using the information of the elapsed time when the information that there is a face of is generated.
また、利用者属性情報は、画像内の人の疲労度を示す情報を含んでよい。この場合、一実施形態に係る機械学習済み機能は、画像と、画像内の人の疲労度を示す情報と、の関係を機械学習済みであり、新たな画像に対して、画像内の人の疲労度を示す情報を生成できてよい。
Further, the user attribute information may include information indicating the degree of fatigue of a person in the image. In this case, the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the degree of fatigue of the person in the image, and for a new image, the person in the image has been machine-learned. It may be possible to generate information indicating the degree of fatigue.
また、利用者属性情報は、画像内の人の集中程度を示す情報を含んでよい。この場合、一実施形態に係る機械学習済み機能は、画像と、画像内の人の集中程度を示す情報と、の関係を機械学習済みであり、新たな画像に対して、画像内の人の集中程度を示す情報を生成できてよい。かかる集中程度を示す情報は、例えば、視線の動き、まばたき頻度、心拍数、呼吸、ため息の回数などの情報を用いて、特定されてよい。また、一実施形態に係る機械学習済み機能は、画像及び音に基づいて、上述の人の集中程度を示す情報を生成してよい。この場合、一実施形態に係る機械学習済み機能は、画像及び音と、画像内の人の集中程度を示す情報と、の関係を機械学習済みであり、新たな画像及び音に対して、画像内の人の集中程度を示す情報を生成できてよい。かかる集中程度を示す情報は、例えば、タイピング音、視線の動き、まばたき頻度、心拍数、呼吸、ため息の回数などの画像及び音の両方の情報を用いて、特定されてよい。なお、画像からの心拍数測定自体は、例えば、http://pacesync.com/のような技術を使用してよい。
Further, the user attribute information may include information indicating the degree of concentration of people in the image. In this case, the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the degree of concentration of the person in the image, and for a new image, the person in the image has been machine-learned. It may be possible to generate information indicating the degree of concentration. The information indicating the degree of concentration may be specified by using information such as the movement of the line of sight, the frequency of blinking, the heart rate, the breathing, and the number of sighs. Further, the machine-learned function according to the embodiment may generate information indicating the degree of concentration of the above-mentioned person based on an image and a sound. In this case, the machine-learned function according to the embodiment has machine-learned the relationship between the image and the sound and the information indicating the degree of concentration of the person in the image, and the image is obtained for a new image and sound. It may be possible to generate information indicating the degree of concentration of people within. Information indicating the degree of concentration may be specified using both image and sound information such as, for example, typing sounds, eye movements, blink frequency, heart rate, respiration, and sigh frequency. For the heart rate measurement itself from the image, for example, a technique such as http://pacesync.com/ may be used.
なお、情報生成部が生成した人の集中程度を示す情報が、所定以上の集中の程度を示す場合、後述の「集中モード」に自動的に切り替えられてよい。また、かかる人の集中程度を示す情報は、各利用者の統計情報の一つとして、利用されてよい。
If the information generated by the information generation unit indicating the degree of concentration of people indicates the degree of concentration above a predetermined level, it may be automatically switched to the "concentration mode" described later. In addition, the information indicating the degree of concentration of such persons may be used as one of the statistical information of each user.
また、利用者属性情報は、画像内の人の健康情報を示す情報を含んでよい。この場合、一実施形態に係る機械学習済み機能は、画像と、画像内の人の健康情報を示す情報と、の関係を機械学習済みであり、新たな画像に対して、画像内の人の健康情報を示す情報を生成できてよい。健康情報は、例えば、人の姿勢、及び/又は、人の撮像装置との距離、を含んでよい。
Further, the user attribute information may include information indicating human health information in the image. In this case, the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the health information of the person in the image, and for a new image, the person in the image has been machine-learned. It may be possible to generate information indicating health information. The health information may include, for example, the posture of the person and / or the distance to the image pickup device of the person.
また、利用者属性情報は、人のステータスを示す情報を含んでよい。この場合、一実施形態に係る機械学習済み機能は、画像及び/又は音と、人のステータスを示す情報と、の関係を機械学習済みであり、新たな画像及び/又は音に対して、人のステータスを示す情報を生成できてよい。なお、人のステータスを含む情報は、電話中、食事中、又は、休憩中、などの情報を含んでよい。かかる人のステータスを含む情報は、上述の機械学習で用いられた情報のように、画像のみ、画像及び音、音のみ、のいずれの情報に基づいて判定されてもよい。
Further, the user attribute information may include information indicating the status of a person. In this case, the machine-learned function according to the embodiment has machine-learned the relationship between the image and / or the sound and the information indicating the status of the person, and the person with respect to the new image and / or the sound. It may be possible to generate information indicating the status of. The information including the status of the person may include information such as during a telephone call, eating, or taking a break. The information including the status of such a person may be determined based on any information of image only, image and sound, and sound only, as in the information used in the machine learning described above.
また、利用者属性情報は、画像内の人の悩みの程度を示す情報を含んでよい。この場合、一実施形態に係る機械学習済み機能は、画像と、画像内の人の悩みの程度を示す情報と、の関係を機械学習済みであり、新たな画像に対して、画像内の人の悩みの程度を示す情報を生成できてよい。ここで機械学習は、例えば、人の動作、及び/又は、人の表情、を含む画像と、かかる画像内の人が感じる悩みの程度と、の関係を用いて、上述の機械学習がされてよい。
Further, the user attribute information may include information indicating the degree of trouble of a person in the image. In this case, the machine-learned function according to one embodiment has machine-learned the relationship between the image and the information indicating the degree of the person's worries in the image, and the person in the image has a new image. It may be possible to generate information indicating the degree of trouble. Here, in machine learning, the above-mentioned machine learning is performed using the relationship between an image including, for example, a person's movement and / or a person's facial expression, and the degree of trouble felt by the person in the image. good.
また、情報生成部は、音を取得する機能を有してよい。音を取得する機能は、上述の撮像装置内を用いたものでもよいし、上述の撮像装置とは別のものでもよい。情報生成部が音を取得する機能を有する場合、情報生成部は、音と、業務中に生じうるであるかないかを判定する情報、との関係を機械学習済みの機械学習部を有してよい。情報生成部は、かかる機械学習部を用いて、取得した音に対し、業務中に生じた音であるかどうかを判定した情報を生成してよい。なお、かかる業務中に生じた音であるかどうかを判定するための機械学習は、例えば、キーボード内のキーをタッチする場合の音に対して、業務中に生じた音であると判定する情報、を関連付けた教師データを含んで機械学習されてよい。この場合、情報処理装置に対する業務上の典型的な入力装置であるキーボードに対する入力によって業務を行うことを推定できる利点がある。なお、業務中に生じた音であるかどうかを判定した情報を含む情報は端末装置から管理装置へ所定のタイミングで送信されてよいが、かかる取得した音自体は、WEBブラウザ上のプログラム内で処理し、端末装置から、管理装置へ送信されないことにより、利用者のプライバシーを保護できる利点がある。上述の業務中に生じた音であるかどうかを判定した情報は、利用者動的属性情報の下位概念であってよい。また、かかる業務中に生じた音であるかどうかを判定した情報は、時刻と関連付けられて、記憶されてよい。
Further, the information generation unit may have a function of acquiring sound. The function of acquiring sound may be one using the inside of the above-mentioned image pickup device, or may be different from the above-mentioned image pickup device. When the information generation unit has a function of acquiring sound, the information generation unit has a machine learning unit that has machine-learned the relationship between the sound and information for determining whether or not it can occur during work. good. The information generation unit may use the machine learning unit to generate information for determining whether or not the acquired sound is a sound generated during work. In addition, the machine learning for determining whether or not the sound is generated during the work is, for example, information for determining that the sound is generated during the work with respect to the sound when a key in the keyboard is touched. , May include machine learning with associated teacher data. In this case, there is an advantage that it can be estimated that the business is performed by the input to the keyboard, which is a typical input device for the business of the information processing device. Information including information for determining whether or not the sound is generated during work may be transmitted from the terminal device to the management device at a predetermined timing, but the acquired sound itself is within the program on the WEB browser. There is an advantage that the privacy of the user can be protected by processing and not transmitting from the terminal device to the management device. The information for determining whether or not the sound is generated during the above-mentioned work may be a subordinate concept of the user dynamic attribute information. In addition, the information for determining whether or not the sound is generated during the work may be stored in association with the time.
また、情報生成部は、画像と関連のない、利用者の「状況を示す情報」を生成してもよい。かかる状況を示す情報は、上述の利用者属性情報の下位概念であってよい。また、かかる状況を示す情報は、上述の利用者動的属性情報の下位概念であってよい。
Further, the information generation unit may generate "information indicating the situation" of the user, which is not related to the image. The information indicating such a situation may be a subordinate concept of the above-mentioned user attribute information. Further, the information indicating such a situation may be a subordinate concept of the above-mentioned user dynamic attribute information.
例えば、情報生成部は、端末装置内のスケジュールを管理するソフトウェアと連携して得られた情報に基づいて、情報を生成してもよい。スケジュールを管理するソフトウェアは、例えば、カレンダー機能を有するソフトウェアであってよい。情報生成部は、例えば、端末装置内のスケジュールを管理するソフトウェアから、所定の時間帯や時刻などの時間に係る情報を用いて、利用者のスケジュールに係る情報を取得し、利用者のスケジュール情報を生成してよい。利用者の「スケジュール情報」は、利用者の状況を示す情報の下位概念であって良い。利用者のスケジュール情報は、利用者の会議に係る情報、及び/又は、利用者の勤務情報、を含んでよい。会議に係る情報は、会議の有無、会議出席者、社内又は社外会議の区別、会議場所、会議形態、及び/又は、会議の終了予定時刻、等を含んでよい。会議形態は、会議がWEB会議であるか、会議に係る情報は、現在の時刻についての会議についての情報のみでもよいし、例えば、本日や本日と翌日等のように所定の期間に開催予定の会議についての情報を含んでもよい。
For example, the information generation unit may generate information based on the information obtained in cooperation with the software that manages the schedule in the terminal device. The software for managing the schedule may be, for example, software having a calendar function. For example, the information generation unit acquires information related to the user's schedule from software that manages the schedule in the terminal device, using information related to time such as a predetermined time zone or time, and the user's schedule information. May be generated. The user's "schedule information" may be a subordinate concept of information indicating the user's situation. The user's schedule information may include information related to the user's meeting and / or user's work information. The information related to the meeting may include the presence or absence of the meeting, the attendees of the meeting, the distinction between internal and external meetings, the meeting place, the meeting form, and / or the scheduled end time of the meeting. The meeting format may be that the meeting is a WEB meeting, or the information related to the meeting may be only the information about the meeting at the current time, and is scheduled to be held in a predetermined period such as today, today and the next day. It may contain information about the meeting.
また、情報生成部は、利用者によって入力された、現在の勤務状況に係る情報を取得して、状況を示す情報を生成してもよい。状況を示す情報は、たとえば、利用者が、集中することを意思表示した情報である「集中モード」を示す情報、を含んでよい。利用者が、集中したい場合にかかる情報を入力でき、かかる情報が他の利用者に伝達されることによって、利用者が集中したいことが他の利用者に周知できる利点がある。なお、「集中モード」は、状況を示す情報の、下位概念の用語であってよい。
Further, the information generation unit may acquire information related to the current work status input by the user and generate information indicating the status. The information indicating the situation may include, for example, information indicating a "concentration mode", which is information indicating that the user intends to concentrate. There is an advantage that the user can input such information when he / she wants to concentrate, and by transmitting such information to other users, he / she can inform other users that he / she wants to concentrate. In addition, "concentrated mode" may be a term of a subordinate concept of information indicating a situation.
また、情報生成部は、後述のように、利用者に係る端末装置の緯度及び経度を公知の技術を用いて特定し、状況を示す情報の下位概念としての端末装置の緯度及び経度を生成してもよい。
Further, as described later, the information generation unit specifies the latitude and longitude of the terminal device related to the user by using a known technique, and generates the latitude and longitude of the terminal device as a subordinate concept of the information indicating the situation. You may.
情報生成部が、利用者属性情報として、特に、利用者動的属性情報として、生成する情報の一例は、図3である。
FIG. 3 is an example of information generated by the information generation unit as user attribute information, particularly as user dynamic attribute information.
2.1.2.情報送信部212
情報送信部は、情報を送信する機能を有する。情報送信部は、情報生成部が生成した情報の一部又は全部を、一又は複数の管理装置に送信してよい。情報送信部は、かかる情報を、種々のタイミングで、送信してよい。たとえば、情報送信部は、一又は複数の管理装置に、30秒毎、1分毎、2分毎、3分毎、5分毎、10分毎、等に情報を送信してよい。
また、情報送信部は、送信する情報の内容に応じて、送信するタイミングを異なるものとして、送信してもよい。また、送信される情報は、前回送信した情報と異なる情報のみを送信し、前回送信した情報と同じ情報は、同じ情報であるという情報のみを送る又は情報を送らない、という処理をしてもよい。また、情報送信部は、送信先の管理装置、に応じて、送信するタイミングを異なるものとしてもよい。 2.1.2. Information transmitter 212
The information transmission unit has a function of transmitting information. The information transmission unit may transmit a part or all of the information generated by the information generation unit to one or more management devices. The information transmission unit may transmit such information at various timings. For example, the information transmission unit may transmit information to one or more management devices every 30 seconds, every minute, every two minutes, every three minutes, every five minutes, every ten minutes, and so on.
Further, the information transmission unit may transmit the information at different timings depending on the content of the information to be transmitted. Further, even if the information to be transmitted is different from the previously transmitted information, only the information that the same information as the previously transmitted information is the same information is transmitted or the information is not transmitted. good. Further, the information transmission unit may have different transmission timings depending on the management device of the transmission destination.
情報送信部は、情報を送信する機能を有する。情報送信部は、情報生成部が生成した情報の一部又は全部を、一又は複数の管理装置に送信してよい。情報送信部は、かかる情報を、種々のタイミングで、送信してよい。たとえば、情報送信部は、一又は複数の管理装置に、30秒毎、1分毎、2分毎、3分毎、5分毎、10分毎、等に情報を送信してよい。
また、情報送信部は、送信する情報の内容に応じて、送信するタイミングを異なるものとして、送信してもよい。また、送信される情報は、前回送信した情報と異なる情報のみを送信し、前回送信した情報と同じ情報は、同じ情報であるという情報のみを送る又は情報を送らない、という処理をしてもよい。また、情報送信部は、送信先の管理装置、に応じて、送信するタイミングを異なるものとしてもよい。 2.1.2. Information transmitter 212
The information transmission unit has a function of transmitting information. The information transmission unit may transmit a part or all of the information generated by the information generation unit to one or more management devices. The information transmission unit may transmit such information at various timings. For example, the information transmission unit may transmit information to one or more management devices every 30 seconds, every minute, every two minutes, every three minutes, every five minutes, every ten minutes, and so on.
Further, the information transmission unit may transmit the information at different timings depending on the content of the information to be transmitted. Further, even if the information to be transmitted is different from the previously transmitted information, only the information that the same information as the previously transmitted information is the same information is transmitted or the information is not transmitted. good. Further, the information transmission unit may have different transmission timings depending on the management device of the transmission destination.
情報送信部は、情報生成部が生成した、利用者属性情報を、一又は複数の管理装置に送信してよい。
The information transmission unit may transmit the user attribute information generated by the information generation unit to one or more management devices.
2.1.3.情報表示部213
情報表示部は、情報を表示する機能を有する。情報表示部は、管理装置から取得した情報に基づいて、情報を表示してよい。情報表示部は、管理装置から、利用者属性情報を複数の利用者について取得し、表示してよい。利用の態様例については、後述する。 2.1.3. Information display unit 213
The information display unit has a function of displaying information. The information display unit may display information based on the information acquired from the management device. The information display unit may acquire and display user attribute information for a plurality of users from the management device. An example of the mode of use will be described later.
情報表示部は、情報を表示する機能を有する。情報表示部は、管理装置から取得した情報に基づいて、情報を表示してよい。情報表示部は、管理装置から、利用者属性情報を複数の利用者について取得し、表示してよい。利用の態様例については、後述する。 2.1.3. Information display unit 213
The information display unit has a function of displaying information. The information display unit may display information based on the information acquired from the management device. The information display unit may acquire and display user attribute information for a plurality of users from the management device. An example of the mode of use will be described later.
2.2.管理装置
管理装置は、情報管理部、及び、情報送信部、を有する。 2.2. Management device The management device has an information management unit and an information transmission unit.
管理装置は、情報管理部、及び、情報送信部、を有する。 2.2. Management device The management device has an information management unit and an information transmission unit.
2.2.1.情報管理部221
情報管理部は、一又は複数の端末装置から、情報を取得して管理する機能を有する。情報管理部が、情報を取得するタイミングは、一又は複数の端末装置から、情報を取得したタイミングであってよい。 2.2.1. Information Management Department 221
The information management unit has a function of acquiring and managing information from one or a plurality of terminal devices. The timing at which the information management unit acquires information may be the timing at which information is acquired from one or a plurality of terminal devices.
情報管理部は、一又は複数の端末装置から、情報を取得して管理する機能を有する。情報管理部が、情報を取得するタイミングは、一又は複数の端末装置から、情報を取得したタイミングであってよい。 2.2.1. Information Management Department 221
The information management unit has a function of acquiring and managing information from one or a plurality of terminal devices. The timing at which the information management unit acquires information may be the timing at which information is acquired from one or a plurality of terminal devices.
情報管理部は、一又は複数の端末装置から取得した情報を、例えば、図4のように、管理してよい。なお、情報管理部は、各端末装置に係る撮像装置によって撮像された画像内に人の顔が継続して含まれていない時間を、管理装置内で測定して、管理してもよい。すなわち、一又は複数の端末装置から、画像内に人の顔が含まれているか含まれていないかの情報を取得し、かかる情報を用いて、人の顔が含まれない最初の時刻を開始時刻として、人の顔が継続して含まれない継続時間を測定して、管理してもよい。
The information management unit may manage information acquired from one or more terminal devices, for example, as shown in FIG. The information management unit may measure and manage the time in which the human face is not continuously included in the image captured by the image pickup device related to each terminal device in the management device. That is, information on whether or not a human face is included in the image is acquired from one or more terminal devices, and the information is used to start the first time when the human face is not included. As the time, the duration that does not continuously include the human face may be measured and managed.
また、情報管理部は、一又は複数の端末装置から取得した情報を用いて、端末装置の場所の情報を生成してよい。情報管理部は、端末装置に係る緯度及び経度を取得して、端末装置の場所の情報を生成してよい。端末装置に係る緯度及び経度は、公知の技術を利用して、端末装置から取得した情報を用いて管理装置内で生成されてもよいし、利用者に係る端末装置内の一実施形態に係るシステムが、公知の技術を利用して緯度及び経度を取得し、かかる情報を、端末装置が、管理装置へ送信することで、情報管理部が、端末装置の緯度及び経度を取得してもよい。情報管理部は、緯度及び経度と、行政区画と、の関係を示すルールを用いて、取得した緯度及び経度を用いて、利用者に係る端末装置の場所としての行政区画を特定してよい。この場合、行政区画は、都道府県及び市町村のみにとどまり具体的な番地を特定しない場合、利用者のプライバシーを保護できる利点がある。また、情報管理部は、緯度及び経度と、利用者が所属する団体内における各場所と関連付けられた名称と、の関係を示すルールを用いて、取得した緯度及び経度を用いて、利用者が所属する団体内における各場所と関連付けられた名称を特定してもよい。この場合、利用者が所属する団体内の名称であることから、行政区画名よりも、団体に所属する人々にとって直感的に理解しやすい名称である利点がある。
Further, the information management unit may generate information on the location of the terminal device by using the information acquired from one or more terminal devices. The information management unit may acquire the latitude and longitude related to the terminal device and generate information on the location of the terminal device. The latitude and longitude related to the terminal device may be generated in the management device using the information acquired from the terminal device by using known technology, or the latitude and longitude in the terminal device according to the user. The system may acquire the latitude and longitude using a known technique, and the terminal device may transmit such information to the management device, so that the information management unit may acquire the latitude and longitude of the terminal device. .. The information management unit may specify the administrative division as the location of the terminal device related to the user by using the acquired latitude and longitude by using the rule showing the relationship between the latitude and longitude and the administrative division. In this case, the administrative division has an advantage that the privacy of the user can be protected if the specific address is not specified only for the prefecture and the municipality. In addition, the information management department uses the acquired latitude and longitude using the rules showing the relationship between the latitude and longitude and the name associated with each place in the organization to which the user belongs. You may specify the name associated with each location within your organization. In this case, since the name is within the organization to which the user belongs, there is an advantage that the name is intuitively easy for people belonging to the organization to understand, rather than the administrative division name.
また、情報管理部は、統計機能を有してもよいし、統計機能を有しなくてもよい。情報管理部が統計機能を有する場合における統計機能について、以下説明する。
Further, the information management unit may or may not have a statistical function. The statistical function when the information management unit has the statistical function will be described below.
統計機能は、端末装置から取得された情報を用いて、統計処理をする機能を含んでよい。例えば、情報管理部は、複数の端末装置から取得した利用者属性情報について、統計処理をしてよい。
The statistical function may include a function of performing statistical processing using information acquired from the terminal device. For example, the information management unit may perform statistical processing on user attribute information acquired from a plurality of terminal devices.
例えば、各人の利用者属性情報について、所定期間の合計及び/又は所定期間の平均を生成してもよいし、各人において、利用者属性情報についての相関関係を生成してもよい。例えば、時間帯と、特定の利用者の在席/離席と、の相関関係を統計処理することによって、特定の利用者が在籍する傾向にある時間帯を生成してよい。かかる在席する傾向にある時間帯が表示される場合、かかる特定の利用者にとっての生活リズムに合わせた会議の設定などに利用できる利点がある。同様に、団体内の特定のグループ内や団体内において、同様に、時間帯と、団体の特定のグループ内や団体内の利用者の在席/離席と、の相関関係を統計処理して、在席の可能性の高い時間帯を生成してよい。かかる在席する可能性の高い時間帯が表示される場合、団体の特定のグループや団体内の利用者の生活リズムに合わせた会議の設定などに利用できる利点がある。
For example, for each person's user attribute information, the total of the predetermined period and / or the average of the predetermined period may be generated, or each person may generate a correlation for the user attribute information. For example, a time zone in which a specific user tends to be enrolled may be generated by statistically processing the correlation between the time zone and the presence / absence of a specific user. When the time zone in which the person tends to be present is displayed, there is an advantage that the meeting can be set according to the life rhythm of the specific user. Similarly, within a specific group within a group or within a group, similarly, statistically process the correlation between the time zone and the presence / absence of a user within a specific group or group within the group. , May generate a time zone that is likely to be present. When such a time zone in which there is a high possibility of being present is displayed, there is an advantage that it can be used for setting a meeting according to the life rhythm of a specific group of a group or a user in the group.
また、例えば、時間帯と、特定の利用者の集中程度を示す情報と、の相関関係を統計処理することによって、特定の利用者が集中する傾向にある時間帯を生成してよい。かかる集中する傾向にある時間帯が表示される場合、かかる特定の利用者にとっての集中のリズムに合わせた会議の設定などに利用できる利点がある。同様に、団体内の特定のグループ内や団体内において、同様に、時間帯と、団体の特定のグループ内や団体内の利用者の集中程度を示す情報と、の相関関係を統計処理して、集中の可能性の高い又は低い時間帯を生成してよい。かかる集中する可能性の高い又は低い時間帯が表示される場合、団体の特定のグループや団体内の利用者の集中のリズムに合わせた会議の設定などに利用できる利点がある。
Further, for example, a time zone in which a specific user tends to concentrate may be generated by statistically processing the correlation between the time zone and the information indicating the degree of concentration of the specific user. When such a time zone that tends to concentrate is displayed, there is an advantage that it can be used for setting a meeting according to the rhythm of concentration for such a specific user. Similarly, within a specific group within a group or within a group, similarly, statistically process the correlation between the time zone and the information indicating the degree of concentration of users within a specific group or group within the group. , May generate time zones with high or low likelihood of concentration. When such a time zone with high or low possibility of concentration is displayed, there is an advantage that it can be used for setting a meeting according to a specific group of a group or a rhythm of concentration of users within the group.
また、時間帯と、特定の利用者の疲労度を示す情報、健康の程度を示す情報、悩みの程度を示す情報と、人のステータスを示す情報、及び/又は、人の集中程度を示す情報、の相関関係を統計処理することによって、特定の利用者が疲労度/健康の程度/悩みの程度/集中程度、についての特定の傾向を生成してよい。かかる特定の傾向が、利用者に表示されることによって、利用者自身が自らの状態を理解できる情報を取得できる利点がある。
In addition, time zone, information indicating the degree of fatigue of a specific user, information indicating the degree of health, information indicating the degree of worries, information indicating the status of a person, and / or information indicating the degree of concentration of a person. By statistically processing the correlation of ,, a specific user may generate a specific tendency regarding the degree of fatigue / degree of health / degree of worries / degree of concentration. By displaying such a specific tendency to the user, there is an advantage that the user can acquire information that can understand his / her own state.
また、各利用者が、雑談などを行うとして連絡する連絡手段が用いられた場合における、各利用者の関係を取得し、利用者間の関係の有無や関係の頻繁さなどを測定するための情報として用いられてもよい。
In addition, in order to acquire the relationship of each user when the contact means for contacting each user is used to have a chat, etc., and to measure the existence or nonexistence of the relationship between the users and the frequency of the relationship. It may be used as information.
2.2.2.情報送信部222
情報送信部は、情報を送信する機能を有する。情報送信部は、情報管理部において管理されている情報の一部又は全部を、一又は複数の端末装置に送信してよい。情報送信部は、かかる情報を、種々のタイミングで、送信してよい。たとえば、情報送信部は、端末装置に、30秒毎、1分毎、2分毎、3分毎、5分毎、10分毎、等に情報を送信してよい。また、情報の対象に応じて、送信するタイミングを同一としてもよいし、異なるものとしてもよい。また、情報送信部は、情報の対象に応じて、送信する頻度を異なるものとしてもよい。例えば、情報送信部は、利用者動的属性情報を定期的に送信する一方、利用者情的属性情報は、利用者がログイン時のみに送信し、その後は別途の要求がある場合を除き送信しないようしてもよい。また、情報送信部が情報を送信するタイミングは、端末装置毎に同じでもよいし、異なってもよい。 2.2.2. Information transmitter 222
The information transmission unit has a function of transmitting information. The information transmission unit may transmit a part or all of the information managed by the information management unit to one or a plurality of terminal devices. The information transmission unit may transmit such information at various timings. For example, the information transmission unit may transmit information to the terminal device every 30 seconds, every minute, every two minutes, every three minutes, every five minutes, every ten minutes, and so on. Further, the transmission timing may be the same or different depending on the target of the information. Further, the information transmission unit may have different transmission frequencies depending on the target of the information. For example, the information transmission unit periodically transmits the user dynamic attribute information, while the user emotional attribute information is transmitted only when the user logs in, and then transmitted unless otherwise requested. You may not do it. Further, the timing at which the information transmitting unit transmits information may be the same or different for each terminal device.
情報送信部は、情報を送信する機能を有する。情報送信部は、情報管理部において管理されている情報の一部又は全部を、一又は複数の端末装置に送信してよい。情報送信部は、かかる情報を、種々のタイミングで、送信してよい。たとえば、情報送信部は、端末装置に、30秒毎、1分毎、2分毎、3分毎、5分毎、10分毎、等に情報を送信してよい。また、情報の対象に応じて、送信するタイミングを同一としてもよいし、異なるものとしてもよい。また、情報送信部は、情報の対象に応じて、送信する頻度を異なるものとしてもよい。例えば、情報送信部は、利用者動的属性情報を定期的に送信する一方、利用者情的属性情報は、利用者がログイン時のみに送信し、その後は別途の要求がある場合を除き送信しないようしてもよい。また、情報送信部が情報を送信するタイミングは、端末装置毎に同じでもよいし、異なってもよい。 2.2.2. Information transmitter 222
The information transmission unit has a function of transmitting information. The information transmission unit may transmit a part or all of the information managed by the information management unit to one or a plurality of terminal devices. The information transmission unit may transmit such information at various timings. For example, the information transmission unit may transmit information to the terminal device every 30 seconds, every minute, every two minutes, every three minutes, every five minutes, every ten minutes, and so on. Further, the transmission timing may be the same or different depending on the target of the information. Further, the information transmission unit may have different transmission frequencies depending on the target of the information. For example, the information transmission unit periodically transmits the user dynamic attribute information, while the user emotional attribute information is transmitted only when the user logs in, and then transmitted unless otherwise requested. You may not do it. Further, the timing at which the information transmitting unit transmits information may be the same or different for each terminal device.
なお、管理装置は、サーバー、クラウド等の業務用の情報処理装置であってもよいが、ノートパソコン、タブレットPC、スマートフォン、携帯電話、などの利用者が業務において使用されうる携帯端末装置の情報処理装置であってもよい。
The management device may be an information processing device for business use such as a server or a cloud, but information on a mobile terminal device that can be used by a user such as a notebook computer, tablet PC, smartphone, or mobile phone in business. It may be a processing device.
3.実施例
3.1.実施形態1
実施形態1は、利用者による利用の流れを一実施形態に係るシステムの画面を用いて、説明する。 3. 3. Example
3.1.Embodiment 1
In the first embodiment, the flow of use by the user will be described using the screen of the system according to the first embodiment.
3.1.実施形態1
実施形態1は、利用者による利用の流れを一実施形態に係るシステムの画面を用いて、説明する。 3. 3. Example
3.1.
In the first embodiment, the flow of use by the user will be described using the screen of the system according to the first embodiment.
まず、利用者は、一実施形態に係るシステムのURLにアクセスする。例えば図5のような画面が示されてよい。なお、かかる画面の前に、利用者は、利用者登録をしてよい。利用者、利用者登録において、ユーザID、メールアドレス、パスワード、等が設定できてよく、これらの利用者登録は、一般的なものであってもよい。
First, the user accesses the URL of the system according to the embodiment. For example, a screen as shown in FIG. 5 may be shown. The user may register as a user before the screen. A user ID, an e-mail address, a password, etc. may be set in the user and user registration, and these user registrations may be general.
次に、利用者が、ログインを行うと、図6のような画面が表示されてよい。画面には、社員リスト01と題するものが表示されてよい。一実施形態のシステムは、WEBブラウザを介して、利用者を示す情報を、表示できるよう動作してよい。
Next, when the user logs in, the screen as shown in FIG. 6 may be displayed. The screen may display what is entitled Employee List 01. The system of one embodiment may operate so that information indicating a user can be displayed via a WEB browser.
一実施形態のシステムは、WEBブラウザを介して、利用者を示す情報を、WEBブラウザに追加的に表示できるよう機能する、追加ボタン02を、表示できるよう動作してよい。利用者がかかる追加ボタンへ入力をした場合、一実施形態のシステムは、WEBブラウザを介して、別途表示されるダイアログなどにより、表示される利用者の候補を示す情報を、表示できるよう動作してよい。利用者が、各利用者を示す情報として表示するものを選択した場合、一実施形態のシステムは、WEBブラウザを介して、利用者が各利用者を示す情報として選択したものを、表示できるよう動作してよい。
The system of one embodiment may operate so that the additional button 02, which functions to additionally display the information indicating the user on the WEB browser, can be displayed via the WEB browser. When a user inputs to such an additional button, the system of one embodiment operates so that information indicating a user candidate to be displayed can be displayed by a dialog or the like separately displayed via a WEB browser. You can do it. When the user selects the information to be displayed as the information indicating each user, the system of one embodiment can display the information selected by the user as the information indicating each user via the WEB browser. It may work.
また、一実施形態のシステムは、WEBブラウザを介して、利用者を示す情報が表示される対象を指示する、表示対象決定ボタン03を、表示できるよう動作してよい。利用者が、かかる表示対象決定ボタン03を選択する場合、一実施形態のシステムは、WEBブラウザを介して、表示対象の指標を示す情報を、表示できるよう動作してよい。表示対象の指標を示す情報は、例えば、所定の集合を示す情報であってもよいし、所定の順序を示す情報であってもよい。なお、表示対象の指標を示す情報、を本願書類において、簡単に「ラベル」ということもある。
Further, the system of one embodiment may operate so that the display target determination button 03, which indicates the target to which the information indicating the user is displayed, can be displayed via the WEB browser. When the user selects the display target determination button 03, the system of one embodiment may operate so that information indicating an index to be displayed can be displayed via a WEB browser. The information indicating the index to be displayed may be, for example, information indicating a predetermined set or information indicating a predetermined order. Information indicating an index to be displayed may be simply referred to as a "label" in the documents of the present application.
所定の集合を示す情報としては、所定の役割を担う集合を示す情報であってもよいし、現在状況を示す情報であってもよいし、その他のものでもよい。所定の役割を担う集合を示す情報とは、例えば、利用者が法人の従業員である場合において法人内の組織の営業部、開発部、研究部、経理部、法務部、などの部署であってよい。この場合、表示対象の指標を示す情報として、営業部、開発部、研究部、経理部、法務部、等の各部署が並列的に選択可能に情報が表示されてよい。かかる部署名は、法人内の名称に合致したものであってよい。また、所定の役割を果たす集合を示す情報は、法人内の組織に限られず、利用者が所属する任意の団体組織において、所定の役割を果たす集合を示す情報であってよい。また、部署として、ログインをした利用者自身が所属する部署が選択候補の最初に表示されてよい。この場合、利用者自身が所属する部署内の情報に早くアクセスできる利点がある。また、表示される対象のデフォルトとして、ログインをした利用者自身が所属する部署が設定されていてもよい。この場合、利用者が、利用者の属する部署内の者とのコミュニケーションをサポートできる利点がある。
The information indicating a predetermined set may be information indicating a set playing a predetermined role, information indicating the current situation, or other information. Information indicating a set that plays a predetermined role is, for example, a department such as a sales department, a development department, a research department, an accounting department, or a legal department of an organization within a corporation when the user is an employee of the corporation. It's okay. In this case, as the information indicating the index to be displayed, the information may be displayed so that each department such as the sales department, the development department, the research department, the accounting department, the legal department, etc. can select in parallel. The department name may match the name within the corporation. Further, the information indicating the set that plays a predetermined role is not limited to the organization within the corporation, and may be the information indicating the set that plays a predetermined role in any group organization to which the user belongs. Also, as a department, the department to which the logged-in user himself belongs may be displayed at the beginning of the selection candidates. In this case, there is an advantage that the information in the department to which the user himself / herself belongs can be accessed quickly. Further, as the default of the displayed target, the department to which the logged-in user himself / herself belongs may be set. In this case, there is an advantage that the user can support communication with a person in the department to which the user belongs.
現在状況を示す情報は、後述するものであってよい。例えば、現在状況を示す情報として、着席、かつ、会議なし、かつ、集中作業中ではない、場合を選択すると、会議や集中作業中ではなく着席した者が表示されることから、その中から雑談できる相手を探す、などのように使用できる利点がある。
The information indicating the current situation may be described later. For example, if you select the case where you are seated, have no meeting, and are not in intensive work as information indicating the current situation, the person who is seated instead of being in a meeting or intensive work is displayed. There is an advantage that it can be used such as finding a person who can do it.
所定の順序を示す情報としては、例えば、利用者の氏名の文字順(あいうえお順やアルファベット順など)であってもよいし、利用者に一意的に割り振られた番号順であってもよい。
The information indicating the predetermined order may be, for example, the character order of the user's name (aiueo order, alphabetical order, etc.) or the number order uniquely assigned to the user.
また、WEBブラウザ内に表示される、利用者を示す情報の対象者は、利用者自身が各々設定できてよく、またかかる利用者自身が設定した、複数の利用者を示す情報、に対して、ラベルを設定してよい。かかる設定により、利用者は、例えば、業務で疲労した場合の雑談相手として仲の良い者を選択する、研究開発時にインスピレーションや相談が可能な相手として同一又は類似の研究を推進する仲間を選択する、などのように雑談相手を利用者毎に一のWEBブラウザ内で表示可能な対象者として、設定できる利点がある。また、かかる雑談相手に加えて、利用者の上司と部下など利用者自身が関係しうる者を選択的に設定可能となり、雑談相手と業務関係者との両方を、一のWEBブラウザ内で表示可能な対象者として、設定できる利点がある。この場合、例えば、利用者は、利用者を示す情報を、複数選択して、かかる複数選択された利用者を示す情報が表示されるものとして、表示対象決定ボタン03により選択される名称、例えば「通常利用1」などのラベルとして、設定可能であってよい。一実施形態のシステムは、利用者によって選択された、複数の、利用者を示す情報の対象者と、かかる複数の対象者を示すラベルと、を関連付けて、記憶してよい。また、かかる利用者を示す情報の複数の対象者は、一つのグループでもよいし、複数のグループでもよく、複数のグループがある場合、各々について、関連付けられて、記憶されてよい。例えば、一の利用者が、複数のプロジェクトに関わっている場合において、プロジェクト毎に、このようなリストを作成してもよい。例えば、図7は、一の利用者が設定した、複数のラベルと、各ラベルと関連付けられて記憶された利用者を示す情報、とを記憶する例である。かかる記憶される場所は、利用者が利用するWEBブラウザ内のキャッシュであってもよいし、管理装置内の記憶装置内にかかる利用者と関連付けられて記憶されてもよい。
Further, the target person of the information indicating the user displayed in the WEB browser may be set by the user himself / herself, and for the information indicating a plurality of users set by the user himself / herself. , You may set the label. With this setting, the user, for example, selects a close friend as a chat partner when he / she is tired from work, and selects a colleague who promotes the same or similar research as a partner who can be inspired and consulted at the time of research and development. There is an advantage that the chat partner can be set as a target person who can be displayed in one WEB browser for each user, such as. In addition to such chat partners, it is possible to selectively set people who can be related to the user, such as the user's boss and subordinates, and both the chat partner and business personnel can be displayed in one WEB browser. There is an advantage that it can be set as a possible target person. In this case, for example, the user selects a plurality of information indicating the user, and the name selected by the display target determination button 03, for example, assuming that the information indicating the plurality of selected users is displayed. It may be configurable as a label such as "normal use 1". The system of one embodiment may associate and store a plurality of subjects of information indicating the user selected by the user and labels indicating the plurality of subjects. Further, the plurality of target persons of the information indicating the user may be one group, may be a plurality of groups, and when there are a plurality of groups, each of them may be associated and stored. For example, when one user is involved in a plurality of projects, such a list may be created for each project. For example, FIG. 7 is an example of storing a plurality of labels set by one user and information indicating a user associated with each label and stored. The storage location may be a cache in the WEB browser used by the user, or may be stored in association with the user in the storage device in the management device.
また、上述の表示対象決定ボタン03によって、区分けされる、利用者を示す情報は、WEBブラウザ内の画面上において、区別されて表示されてもよい。例えば、プロジェクト1に係る利用者を示す情報が、WEBブラウザ内の画面の第1列目に表示され、プロジェクト2係る利用者を示す情報が、WEBブラウザ内の画面の第2列目に表示される、など一のWEBブラウザ内で表示される利用者を示す情報が、複数のグループに区別されて、表示されてもよい。複数のグループに区別されて表示されていることにより、利用者は、状況を知りたい他の利用者に対して、即座に対応できる利点がある。また、かかる複数のグループに区別されて表示される態様は、各グループ内の利用者を示す情報が排他的であってもよいし、一部重複があってもよい。
Further, the information indicating the user, which is classified by the above-mentioned display target determination button 03, may be displayed separately on the screen in the WEB browser. For example, the information indicating the user related to the project 1 is displayed in the first column of the screen in the WEB browser, and the information indicating the user related to the project 2 is displayed in the second column of the screen in the WEB browser. Information indicating a user displayed in one WEB browser may be divided into a plurality of groups and displayed. By being displayed separately in a plurality of groups, the user has an advantage that he / she can immediately respond to other users who want to know the situation. Further, in the mode in which the information indicating the users in each group is displayed separately in the plurality of groups, the information indicating the users in each group may be exclusive or may be partially duplicated.
一実施形態のシステムは、WEBブラウザを介して、各利用者が、現在、どのような状況であるかを、示す情報である、現在状況を示す情報04を、表示できるよう動作してよい。現在状況を示す情報は、文字によって、利用者の状況を示す情報を表示してよい。例えば、在席中(着席)、離席、オフライン、集中モード、などであってよい。また、現在状況を示す情報は、文字に加えて、又は、文字に代えて、色によっても、各利用者が、現在、どのような状況であるかを示す情報を表示してもよい。例えば、図8は、一実施形態のシステムが取得する情報と関連付けられて表示される色の情報が記憶されている関係を示すものである。このような関係が、記憶されていてよい。本図では、各色は、種々の情報に応じて、表示されるよう設定されていることが示されている。例えば、ログインの有無、集中モードの有無、WEB会議ボタンの入力の有無、離席時間の程度、及び/又は、会議の有無、に応じて、表示するステータスと色が設定されている。より具体的には、ログインがない場合は、「オフライン」と表示し、灰色を示す。ログインしていることを前提に、集中モードの場合は、「集中作業中」と表示し、オレンジ色を示す。そして集中モードがオフであることを前提に、WEB会議ボタンへの入力がある場合は、赤を示す。また、WEB会議ボタンへの入力がオフであることを前提として、経過時間に応じて、表示と色とが変更して表示されてよい。特に、経過時間に応じて、離席時間が表示される場合、利用者は、どの程度離席しているかの時間を理解できる利点がある。
The system of one embodiment may operate so that each user can display information 04 indicating the current status, which is information indicating the current status, via a WEB browser. As the information indicating the current situation, the information indicating the user's situation may be displayed in characters. For example, it may be in the presence (seated), away from the seat, offline, concentrated mode, and the like. Further, the information indicating the current situation may display information indicating what kind of situation each user is currently in, in addition to the characters or by color instead of the characters. For example, FIG. 8 shows a relationship in which color information displayed in association with information acquired by the system of one embodiment is stored. Such a relationship may be remembered. In this figure, it is shown that each color is set to be displayed according to various information. For example, the status and color to be displayed are set according to the presence / absence of login, the presence / absence of the centralized mode, the presence / absence of input of the WEB conference button, the degree of leaving time, and / or the presence / absence of a conference. More specifically, if there is no login, "offline" is displayed and grayed out. Assuming that you are logged in, in the intensive mode, "Intensive work" is displayed and the color is orange. And, assuming that the centralized mode is off, if there is an input to the WEB conference button, it is shown in red. Further, on the premise that the input to the WEB conference button is off, the display and the color may be changed and displayed according to the elapsed time. In particular, when the leaving time is displayed according to the elapsed time, there is an advantage that the user can understand how much time he / she is away from.
また、一実施形態のシステムは、WEBブラウザを介して、各利用者が、現在どの場所にいるかを示す情報である、現在の場所を示す情報05を、表示できるよう動作してよい。現在の場所を示す情報は、利用者の属する集団における場所を示す情報、及び/又は、所定の行政区画を示す情報、であってよい。利用者の属する集団における場所を示す情報としては、例えば、利用者の属する法人等の団体内における、各オフィス、各工場、各支所、各営業所などの、名称、略称、等であってよい。かかる情報が表示される場合、利用者は、より利用者の属する法人等の団体内における理解しやすい情報によって理解できる利点がある。また、行政区画を示す情報は、所定の範囲で抽象化されていてよい。例えば、市町村を示す情報は含まれてよいが、市町村よりも具体化される数値情報は含まれなくてよい。このような場合、利用者のプライバシーを保護できる利点がある。
Further, the system of one embodiment may operate so that the information 05 indicating the current location, which is the information indicating the current location of each user, can be displayed via the WEB browser. The information indicating the current location may be information indicating a location in the group to which the user belongs and / or information indicating a predetermined administrative division. The information indicating the location in the group to which the user belongs may be, for example, the name, abbreviation, or the like of each office, each factory, each branch, each sales office, etc. within the organization such as the corporation to which the user belongs. .. When such information is displayed, the user has an advantage that it can be understood by information that is easier to understand within an organization such as a corporation to which the user belongs. Further, the information indicating the administrative division may be abstracted within a predetermined range. For example, information indicating a municipality may be included, but numerical information that is more specific than a municipality may not be included. In such a case, there is an advantage that the privacy of the user can be protected.
また、一実施形態のシステムは、WEBブラウザを介して、各利用者の静的属性情報である、静的属性情報06を、表示できるよう動作してよい。静的属性情報は、例えば、利用者自身を示すアイコン、利用者の氏名、利用者の管理番号、利用者の所属部署名、利用者の地位、利用者の関係プロジェクト、などを示す情報を、含んでよい。かかる静的属性情報が表示されることにより、どのような人であるかを、一目で理解できる利点がある。なお、利用者自身を示すアイコンは、利用者を特定する観点で、利用者を過去に撮像した固定化された画像を含んだり、利用者のリアルタイムの画像に基づくアバターの画像は含んでもよいが、利用者をリアルタイムに撮像している画像は含まない。利用者をリアルタイムに撮像している画像が表示されないことで、利用者がリアルタイムに何をしているか不明であるとしても、業務中といえども各利用者のプライバシーを保護することができる利点がある。なお、上述のアバターは、例えば、利用者をリアルタイムに撮像する画像に基づいてかかる画像を取得した利用者端末に係るWEBブラウザ上のプログラムは対応するアバターの動きを生成し、かかるアバターのリアルタイムの動きを管理端末に送信し、管理端末はかかるアバターのリアルタイムの動きを各利用者端末に送信して各利用者端末上でかかるアバターのリアルタイムの動きを表示することによって実現されてよい。特に、WEBブラウザ上で実行されているプログラムが、利用者のリアルタイムの動きに応じてアバターの動きを生成できることにより、利用者のプライバシーを保護しつつ、動きを他の利用者に共有できる利点がある。なお、上述のアバターの動きは、人を撮像した画像内の人の骨格の動きを機械学習部によって特定することで、特定された人の骨格の動きをアバターの動きに反映させてよい。
Further, the system of one embodiment may operate so that the static attribute information 06, which is the static attribute information of each user, can be displayed via the WEB browser. The static attribute information includes, for example, an icon indicating the user himself / herself, a user's name, a user's management number, a user's department name, a user's status, a user's related project, and the like. May include. By displaying such static attribute information, there is an advantage that it is possible to understand at a glance what kind of person it is. The icon indicating the user himself / herself may include a fixed image obtained by capturing the user in the past or an image of an avatar based on the user's real-time image from the viewpoint of identifying the user. , Does not include images that capture the user in real time. By not displaying the image that captures the user in real time, there is an advantage that the privacy of each user can be protected even during work even if it is unknown what the user is doing in real time. be. The above-mentioned avatar is, for example, a program on the WEB browser related to the user terminal that has acquired such an image based on an image that captures the user in real time, and generates the movement of the corresponding avatar, and the real time of the avatar. The movement may be realized by transmitting the movement to the management terminal, and the management terminal transmits the real-time movement of the avatar to each user terminal and displays the real-time movement of the avatar on each user terminal. In particular, the program running on the WEB browser can generate the movement of the avatar according to the real-time movement of the user, which has the advantage of being able to share the movement with other users while protecting the privacy of the user. be. As for the movement of the avatar described above, the movement of the skeleton of the specified person may be reflected in the movement of the avatar by specifying the movement of the skeleton of the person in the image of the person captured by the machine learning unit.
他方、上述と異なり、WEBブラウザ上で実行されているプログラムは、撮像装置から取得した画像そのものを、利用者属性情報内情報としてではなく、一の端末端末から、管理装置に送信し、管理装置はかかる一の端末装置以外の各端末装置にかかる画像を送信して、各端末装置に係るWEBブラウザ上で、一の利用者のリアルタイムの画像を閲覧できるよう構成されてもよい。この場合、一利用者のリアルタイムの画像が各利用者から見える利点がある。
On the other hand, unlike the above, the program executed on the WEB browser sends the image itself acquired from the image pickup device to the management device from one terminal terminal, not as the information in the user attribute information, and the management device. May be configured to transmit the image to each terminal device other than the one terminal device so that the real-time image of one user can be viewed on the WEB browser related to each terminal device. In this case, there is an advantage that a real-time image of one user can be seen by each user.
また、一実施形態のシステムは、WEBブラウザを介して、各利用者に対して接触可能とするための手段を提供する、連絡提供手段07を、表示できるよう動作してよい。かかる連絡提供手段07は、他のアプリケーションと連携し、かかる連絡提供手段07と関連付けられている利用者に対して、連絡を可能とする手段を起動するものであってよい。例えば、連絡提供手段は、端末装置内にインストールされている電子メールの送受信が実行可能なソフトウェアにおいて表示と関連付けられている利用者を宛先とした新規な電子メールを作成して起動する、端末装置内にインストールされている音声及び/又はチャットを実行可能なソフトウェアにおいて表示と関連付けられている利用者を宛先とした新規なものを作成して起動する、及び/又は、端末装置で実行可能な通話機能において表示と関連付けられている利用者を通話先とした電話を起動できる、ものなどであってよい。なお、一実施形態のシステム自体は、連絡手段のツールとしての常時音声会話機能を有しなくてよい。これにより、利用者は、常時音声会話がされていないことによる安心感を得て、必要な場合に限り他のアプリケーションによる音声会話機能を発動させればよいので、よりプライバシーの保護が可能となる利点がある。
Further, the system of one embodiment may operate so as to be able to display the contact providing means 07, which provides the means for making contact with each user via the WEB browser. The contact providing means 07 may cooperate with another application and activate a means for enabling contact with the user associated with the contact providing means 07. For example, the contact providing means is a terminal device that creates and activates a new e-mail addressed to a user associated with the display in software installed in the terminal device that can send and receive e-mail. Create and launch a new one addressed to the user associated with the display in the software that can execute voice and / or chat installed in, and / or make a call that can be executed on the terminal device. It may be something that can activate a phone with the user associated with the display in the function as the call destination. The system itself of one embodiment does not have to have a constant voice conversation function as a tool for communication means. As a result, the user can feel reassured that the voice conversation is not always performed, and can activate the voice conversation function by another application only when necessary, so that the privacy can be further protected. There are advantages.
また、一実施形態のシステムは、WEBブラウザを介して、利用者に係る撮像装置の制御権限を一時的に放棄する、「WEB会議」08を、表示できるよう動作してよい。利用者が、かかるWEB会議08を入力することにより、一実施形態のシステムは、利用者端末に係る撮像装置からの画像を取得するためのアクセスを、第1所定の期間、停止してよい。かかる第1所定の期間、画像を取得するためのアクセスを停止することにより、利用者がWEB会議を始める前に、再度、一実施形態のシステムが、利用者端末に係る撮像装置にアクセスを試みて撮像装置の権限を奪うことを防止できる。すなわち、利用者は、第1所定の期間の猶予をもって、WEB会議に入ることにより、WEB会議に係るアプリケーションが、当該利用者に係る撮像装置のアクセス権限を有することができる利点がある。かかる構成は、一般的に情報処理装置において、利用者の顔を撮像可能な撮像装置は、一つであることが多いことから、かかる一つの撮像装置の競合を防止できる利点がある。また、内部の撮像装置が複数あったりUSB等の外部への端末を介して一の情報処理装置に係る撮像装置が複数ある場合においても、スマートフォンやタブレットPCなどは、一つの撮像装置の撮像方向が情報処理装置の表示装置の表示方向と同一であり、表示装置の表示方向の対する側に人の顔があることが多いことから、かかる表示装置の表示方向と同一の撮像方向を有する撮像装置について、同一の撮像装置の競合を防止できる利点がある。また、かかる第1所定の期間の経過後、一実施形態のシステムは、利用者端末に係る撮像装置からの画像を取得するためのアクセスを、第2所定の期間毎に、試みる機能を有してよい。このように画像を取得するためのアクセスを自動的に試みる機能により、利用者がWEB会議等の後等に、一実施形態に係るシステムが撮像装置を利用する設定を失念しても、一実施形態に係るシステムが撮像装置を自動的に利用できる利点がある。
Further, the system of one embodiment may operate so as to be able to display "WEB conference" 08, which temporarily abandons the control authority of the image pickup device related to the user, via the WEB browser. When the user inputs the WEB conference 08, the system of one embodiment may suspend the access for acquiring the image from the image pickup device according to the user terminal for the first predetermined period. By stopping the access for acquiring the image for the first predetermined period, the system of one embodiment tries to access the image pickup device related to the user terminal again before the user starts the WEB conference. It is possible to prevent depriving the authority of the image pickup device. That is, by entering the WEB conference with the grace of the first predetermined period, the user has an advantage that the application related to the WEB conference can have the access authority of the image pickup device related to the user. In general, in an information processing device, such a configuration has an advantage that a conflict between the one image pickup device can be prevented because there is often only one image pickup device capable of taking an image of the user's face. Further, even when there are a plurality of internal image pickup devices or a plurality of image pickup devices related to one information processing device via an external terminal such as a USB, a smartphone, a tablet PC, or the like has an image pickup direction of one image pickup device. Is the same as the display direction of the display device of the information processing device, and there is often a human face on the side opposite to the display direction of the display device. Therefore, the image pickup device has the same image pickup direction as the display direction of the display device. Has the advantage of being able to prevent conflicts between the same image pickup devices. Further, after the elapse of the first predetermined period, the system of one embodiment has a function of attempting access for acquiring an image from the image pickup device related to the user terminal every second predetermined period. It's okay. With the function that automatically tries to access to acquire an image in this way, even if the user forgets to set the image pickup device to be used by the system according to the embodiment after a WEB conference or the like, one implementation is performed. There is an advantage that the system according to the form can automatically use the image pickup device.
また、一実施形態のシステムは、WEBブラウザを介して、利用者が集中モードに入る入力を受け付けるためのボタン09を、表示できるよう動作してよい。この場合、利用者が集中モードに入ることが、後述の実施形態のように、他の利用者の端末装置に伝達されることから、利用者の意思を尊重できる利点がある。
Further, the system of one embodiment may operate so that the button 09 for accepting the input for the user to enter the centralized mode can be displayed via the WEB browser. In this case, since the user entering the centralized mode is transmitted to the terminal device of another user as in the embodiment described later, there is an advantage that the intention of the user can be respected.
また、一実施形態のシステムは、チャット機能を有してもよい。チャット機能は、通常のチャット機能であってもよいし、通常のチャット機能に代えて、以下の一つ以上の機能を有するチャット機能であってもよい。
Further, the system of one embodiment may have a chat function. The chat function may be a normal chat function, or may be a chat function having one or more of the following functions instead of the normal chat function.
一実施形態に係るチャット機能は、例えば、図15のように、各利用者を示すパネル上に表示された、各利用者と関連付けられてチャット機能の呼び出しアイコン01、に対する入力により、起動されてよい。かかる起動されるものは、かかるアイコンと関連付けられた利用者を宛先とするチャット機能であってよい。図16は、かかるアイコンがクリックなどにより選択された後の画面例を示すものであり、相手先に対するチャットのメッセージが入力可能に表示されている例である。利用者は、相手先利用者に対するメッセージを、かかるボックスに入力し、「送信する」との選択により、呼び出しアイコン01と関連付けられた利用者を宛先としたメッセージを送信可能であってよい。
The chat function according to one embodiment is activated by inputting to the call function call icon 01 associated with each user, which is displayed on the panel showing each user, as shown in FIG. 15, for example. good. The activation may be a chat function addressed to the user associated with the icon. FIG. 16 shows an example of a screen after the icon is selected by clicking or the like, and is an example in which a chat message to the other party is displayed so as to be inputtable. The user may be able to enter a message for the other user in such a box and select "Send" to send a message addressed to the user associated with the call icon 01.
また、一実施形態に係るチャット機能は、例えば、図17のように、画面上部に、チャットのメッセージの受信を知らせる通知アイコン01が表示可能であってよい。通知アイコンは、利用者に対するチャットのメッセージを受信した場合に、例えば、受信したメッセージの数と共に関連付けられて表示可能であってよい。また、かかるアイコンが、利用者によってクリックなどにより選択されると、一又は複数の受信したメッセージのうちの一部又は全部のメッセージの一部又は全部が、各メッセージの送信者に係る利用者を示す情報と共に関連付けられて、受信メッセージ02として表示されてよい。ここで、各利用者に係るメッセージ03は、予め所定の文字数に制限されてよい。その場合、表示されるスペースを所定の範囲に限定し、まず、受信したメッセージの一覧を理解できる利点がある。本図においては、3人の利用者から、各々メッセージを受信した例である。利用者は、これらのメッセージに対して、「ごめんねする」04という否定的な回答をしてもよいし、「返事する」05という具体的なメッセージで、各メッセージに対して、回答してもよい。また、かかる各利用者に係るメッセージ03は、受信したメッセージの一部(受信したメッセージの一部の利用者及び/又は一部のメッセージ)であることから、全体を見ることができるように「もっと見る」06をクリックなど選択することにより、受信したメッセージの全体(受信した全員の利用者のリスト及び/又は受信した一の利用者に係るメッセージの制限去れていない範囲を含むもの)を表示できてよい。
Further, the chat function according to the embodiment may be capable of displaying a notification icon 01 notifying the reception of a chat message at the upper part of the screen, for example, as shown in FIG. The notification icon may be associated and displayable, for example, with the number of messages received when a chat message to the user is received. In addition, when such an icon is selected by a user by clicking or the like, a part or all of a part or all of the received messages may be a user related to the sender of each message. It may be associated with the indicated information and displayed as a received message 02. Here, the message 03 related to each user may be limited to a predetermined number of characters in advance. In that case, there is an advantage that the displayed space is limited to a predetermined range and the list of received messages can be understood first. In this figure, it is an example of receiving a message from each of three users. The user may respond to these messages with a negative response of "I'm sorry" 04, or may respond to each message with a specific message of "Reply" 05. good. Further, since the message 03 related to each user is a part of the received message (a part of the received message and / or a part of the message), the whole can be seen. Click "More" 06 to display the entire received message (including the list of all received users and / or the limited range of messages related to one received user). You can do it.
図18は、上述における「返事をする」を選択した場合における画面例である。メッセージを受信した複数の利用者に係るメッセージのうちの、一のみのメッセージに係る「返事をする」を選択した場合に、かかる選択された利用者に係るメッセージが表示され、返信が可能であるよう構成されてよい。ここで、かかる選択された利用者と、自分との間のチャット画面が表示され、過去のメッセージのやり取りの履歴を、保持したものであってもよいし、保持ないものであってもよい。
FIG. 18 is an example of a screen when "Reply" is selected above. If you select "Reply" for only one message among the messages for multiple users who have received the message, the message for the selected user is displayed and you can reply. It may be configured as follows. Here, a chat screen between the selected user and himself / herself is displayed, and the history of past message exchanges may or may not be retained.
また、図19は、上述における「もっと見る」を選択した場合における画面例である。かかる画面では、受信した自分宛を含む一又は複数のメッセージを、同一ウィンドウ内で同時に表示してよい。同一ウィンドウ内で表示できる場合、一目で、自分宛を含むメッセージを理解できる利点がある。また、自分宛を含むメッセージとして表示された複数のメッセージの一部又は全部に対して、同一表示内で、複数の宛先宛てのメッセージの入力が可能とする機能を備えてよい。この場合、自分宛のメッセージについて、メッセージ毎に、メッセージの表示、返信、入力、等のステップを踏むことなく、一括で、所定期間内の自分宛のメッセージの一部又は全てについて、同時に表示させて返信の情報を入力できる利点がある。これは、多数のメッセージをやり取りする場合において、メール処理の時間を纏めて設ける等を行う業務の進め方をする場合等において、メールの送信に使用する個々の時間を短縮できる利点がある。特に、WEBブラウザ上において、個々の宛先に対するメールの表示、返信、入力、という複数の各ステップにおいてウィンドウが表示される場合と比べて、複数の宛先に対する入力について、仮に個々の宛先に対する入力メッセージが異なる場合においても、表示される一のウィンドウにおいて複数の宛先に対する各メッセージが入力可能であることにより、処理速度が向上する利点がある。
Further, FIG. 19 is an example of a screen when "more" is selected as described above. On such a screen, one or more messages including the received message may be displayed simultaneously in the same window. If it can be displayed in the same window, there is an advantage that you can understand the message including yourself at a glance. In addition, it may be provided with a function that enables input of a message addressed to a plurality of destinations within the same display for a part or all of a plurality of messages displayed as a message including oneself. In this case, for each message addressed to you, part or all of the messages addressed to you within the specified period will be displayed at the same time without taking steps such as displaying, replying, and inputting the message. There is an advantage that you can enter the reply information. This has the advantage that when exchanging a large number of messages, the individual time used for sending e-mail can be shortened when proceeding with the business such as setting the time for processing e-mail collectively. In particular, compared to the case where a window is displayed in each of multiple steps of displaying, replying, and inputting an email to an individual destination on a WEB browser, an input message for each destination is tentatively displayed for input to multiple destinations. Even if they are different, there is an advantage that the processing speed is improved by being able to input each message to a plurality of destinations in one displayed window.
ここで、受信した各メッセージ01に対し、返信として個々にメッセージ02を入力して、返信03をしてもよい。また、かかる対応に代えて、定型文04による返信が可能であってよい。定型文を利用することにより、例えば、クリックするのみで返信文を入力することが可能であるなど、利用者の処理負担を減少できる利点がある。具体的な文字列としての定型文は、利用者が普段使用するものであってよい。また、定型文は、全ての利用者で同じ文字列であってもよいし、利用者毎に異なる文字列であってもよい。後者の場合、各利用者が利用する定型文を、設定できてよい。各利用者が設定した各定型文は、各利用者に係るWEBブラウザ内のキャッシュに記憶されてもよいし、管理装置において各利用者と関連付けられて定型文として記憶されてもよい。かかる定型文は、2つ以上があり、利用者によって定型文が選択された場合に、かかる2以上の発信可能な定型文の候補が表示され、そこから選択された定型文によって返信可能であってよい。この場合、利用者の意図に応じて、定型文を選択できる利点がある。また、かかる構成に代えて、定型文が一つのみであり、利用者によって定型文として選択されたことにより、かかる一つのみの定型文でもよい。この場合、定型文を選択する負担も減少する利点がある。
Here, for each received message 01, the message 02 may be individually input as a reply and the reply 03 may be sent. Further, instead of such a response, it may be possible to reply by the fixed phrase 04. By using a fixed phrase, there is an advantage that the processing burden on the user can be reduced, for example, it is possible to input a reply sentence only by clicking. The fixed phrase as a specific character string may be one that the user usually uses. Further, the fixed phrase may be the same character string for all users, or may be a different character string for each user. In the latter case, a fixed phrase used by each user may be set. Each fixed phrase set by each user may be stored in a cache in the WEB browser related to each user, or may be associated with each user in the management device and stored as a fixed phrase. There are two or more such fixed phrases, and when the fixed phrase is selected by the user, two or more candidates for the fixed phrases that can be sent are displayed, and it is possible to reply by the fixed phrase selected from the candidates. You can do it. In this case, there is an advantage that a fixed phrase can be selected according to the intention of the user. Further, instead of such a configuration, there is only one fixed phrase, and since the fixed phrase is selected by the user, only one fixed phrase may be used. In this case, there is an advantage that the burden of selecting a fixed phrase is also reduced.
また、チャット機能は、入力機能として、単にメッセージに対してYes/Noを伝える「OKです」「ごめんね」ボタンが付随してもよい。この場合、メッセージに対する返信を簡易に行うことができる利点がある。本図においては、「ごめんねする」のみが表示されているが、かかる表示と共に、または、かかる表示に代えて、「OKです」ボタンが表示されてもよい。
In addition, the chat function may be accompanied by "OK" and "Sorry" buttons that simply convey Yes / No to the message as an input function. In this case, there is an advantage that the reply to the message can be easily performed. In this figure, only "I'm sorry" is displayed, but the "OK" button may be displayed together with or in place of such a display.
また、チャット機能は、送信機能として、図面には明示されていないが、複数の利用者に対して、同一のメッセージを作成可能な機能を起動させるアイコンを表示してもよい。また、かかる同一のメッセージは、送信の指示により、同時に発信可能であってよい。メッセージの宛先としての複数の利用者は、種々の観点で特定されてよく、複数の利用者は所定のフィルターによって特定されてよい。例えば、利用者の利用者情的属性情報に基づいて特定されてもよいし、利用者の利用者動的属性情報に基づいて特定されてもよいし、利用者の利用者動的属性情報及び利用者情的属性情報に基づいて特定されてもよい。利用者情的情報に基づく場合は、例えば、利用者が属する団体と同一の団体に属する利用者であってもよいし、利用者が属する団体内のグループと同一のグループに属する利用者であってもよい。前者は、例えば、法人内の全員に対するメッセージとなるし、後者であれば、同じ部課やプロジェクトなどの同一のグループに属する利用者に対するメッセージとなる。また、利用者動的属性情報に基づく場合は、例えば、メッセージの相手方としての複数の利用者として、現在在席中の利用者のみ、現在所定のオフィス内にいる人のみ、所定の範囲の場所にいる人のみ、現在会議中でない人のみ、現在集中モードでない人のみ、現在会議中でなくかつ現在集中モードでない人のみ、などであってよい。かかる場合、利用者の現在の具体的な状況に応じて、メッセージが可能となる利点がある。例えば、複数の利用者として、自己の属するオフィスにいる人である場合や、所定の範囲の場所にいる人である場合、については、お昼のランチを一緒に誘う場合等に利用できる利点がある。また、現在会議中でなくかつ現在集中モードでない人のみは、ブレーンストーミングを誘う場合等に利用できる利点がある。
In addition, although the chat function is not specified in the drawing as a transmission function, an icon for activating a function capable of creating the same message may be displayed for a plurality of users. Further, the same message may be simultaneously transmitted according to the transmission instruction. A plurality of users as destinations of a message may be specified from various viewpoints, and a plurality of users may be specified by a predetermined filter. For example, it may be specified based on the user emotional attribute information of the user, it may be specified based on the user dynamic attribute information of the user, the user dynamic attribute information of the user, and the user dynamic attribute information of the user. It may be specified based on user emotional attribute information. When based on user emotional information, for example, the user may belong to the same group as the group to which the user belongs, or the user belongs to the same group as the group within the group to which the user belongs. You may. The former is, for example, a message to everyone in the corporation, and the latter is a message to users who belong to the same group such as the same department or project. In addition, when based on user dynamic attribute information, for example, as multiple users as the other party of a message, only the currently present user, only the person currently in the predetermined office, the location in the predetermined range. Only those who are currently in the meeting, only those who are not currently in the meeting, only those who are not currently in the intensive mode, only those who are not currently in the meeting and are not currently in the intensive mode, and so on. In such a case, there is an advantage that the message can be made according to the current specific situation of the user. For example, as multiple users, if you are in the office to which you belong, or if you are in a certain range of places, there is an advantage that you can use it when inviting lunch together for lunch. .. In addition, there is an advantage that only those who are not currently in a meeting and are not currently in the intensive mode can use it when inviting brainstorming.
また、チャットを発信する場合やチャットを受信する場合等における相手方について、過去のメッセージの履歴を表示する機能があってもよいし、過去のメッセージの履歴を表示しない機能があってもよい。前者の場合、過去の履歴の表示は所定の時間が経過するとメッセージの表示が消滅されてもよい。後者の場合、過去のメッセージの履歴を表示しないことにより画面スペースの有効利用が可能な利点がある。
Further, there may be a function of displaying the history of past messages or a function of not displaying the history of past messages for the other party when sending a chat or receiving a chat. In the former case, the display of the past history may disappear after a predetermined time has passed. In the latter case, there is an advantage that the screen space can be effectively used by not displaying the history of past messages.
また、一実施形態に係るシステムは、利用者を撮像した画像に基づき、受信したメッセージの既読の有無を判定する機能を有してよい。かかる機能は、画像と、受信したメッセージに係る情報と、既読の有無と、の関係を機械学習した機械学習部を有し、かかる機械学習済みの機械学習部が、新たに取得した画像と受信したメッセージに係る情報とに基いて、メッセージの既読の有無を判定してよい。メッセージに係る情報は、受信した一又は複数のメッセージの表示位置及び/又はメッセージの表示のタイミング、を含んでよい。また、かかる受信した一又は複数のメッセージの表示位置は、一のメッセージにおける全体が表示された場合であってもよいし、一のメッセージの一部のみが表示された段階でもよい。また、表示された一又は複数のメッセージの表示位置に対する既読の有無は、表示された一又は複数のメッセージの全体に対して、全てのメッセージが表示されたものと既読の有無が判定されるものであってもよいし、表示された一又は複数のメッセージのうちの各メッセージについて既読の有無が判定されるものであってもよい。前者の場合は、表示された一又は複数のメッセージの全体に対して、判定された既読の有無が生成されるが、後者の場合は、表示された一又は複数のメッセージのうちの各メッセージについて、判定された既読の有無が生成されてよい。かかる構成において、例えば、画像は、画像内の人の視線の方向を用いるものであってよいが、これに限られない。また、受信された一又は複数のメッセージの全体又は各々のメッセージについて、既読及び/又は未読と判定されている情報は、管理装置を介して、各メッセージの送信元に係る利用者端末に送信され、利用者端末において、各メッセージの既読又は未読の情報が表示されてよい。この場合、利用者に係る画像に基づいて、利用者が具体的にクリックなどをしない場合においても、既読の有無を、メッセージの送信元が理解できる利点がある。かかる機能は、利用者が、各メッセージをクリックする等して閲覧した情報が、メッセージの送信元において表示される機能と、併存してもよいし、かかる機能のみがあってもよい。
Further, the system according to the embodiment may have a function of determining whether or not the received message has been read based on the image captured by the user. Such a function has a machine learning unit that machine-learns the relationship between an image, information related to a received message, and whether or not it has been read, and the image newly acquired by the machine-learned machine learning unit. It may be determined whether or not the message has been read based on the information related to the received message. The information relating to the message may include the display position of one or more received messages and / or the display timing of the message. Further, the display position of the received one or more messages may be the case where the whole of the one message is displayed, or the stage where only a part of the one message is displayed. In addition, whether or not the displayed one or more messages have been read for the display position is determined as to whether or not all the messages have been displayed and whether or not all the displayed messages have been read for the entire displayed one or more messages. It may be a message, or it may be determined whether or not each message among the displayed one or a plurality of messages has been read. In the former case, the presence or absence of read is determined for the entire displayed one or more messages, but in the latter case, each message of the displayed one or more messages is generated. The determined read presence / absence may be generated for. In such a configuration, for example, the image may use the direction of the line of sight of a person in the image, but is not limited to this. In addition, information determined to be read and / or unread for all or each of the received messages is transmitted to the user terminal related to the sender of each message via the management device. Then, the read or unread information of each message may be displayed on the user terminal. In this case, there is an advantage that the sender of the message can understand whether or not the message has been read even when the user does not specifically click based on the image related to the user. Such a function may coexist with a function in which the information browsed by the user by clicking each message is displayed at the sender of the message, or may have only such a function.
また、一実施形態に係るシステムは、WEB通話機能を有してもよい。WEB通話は、通常の音声機能を有してよいが、通常の音声機能と異なる機能を有してもよい。このとき、一実施形態に係るシステムは、取得した画像に基づき、リアルタイムに、利用者のストレス状況を示す情報を取得してもよい。ここで、ストレス状況を示す情報は、例えば、ストレスの程度を示す数値であってもよいしランクであってもよい。数値は、例えば、ストレスがない状態を0としてストレスが強い場合を100とした場合の1乃至100の間の数値等であってよく、ランクは、ストレスの低・中・強などの複数のうちの一が指定されるもの等であってよい。かかるストレス状況を示す情報は、一実施形態に係るシステムが、画像と、ストレス状況を示す情報と、の関係を機械学習済みの機械学習部を有し、WEB通話中に新たに取得した画像に対してかかる機械学習部が適用されることで、生成されてよい。かかる機械学習部は、WEB通話中に画像から得られる、例えば、利用者が、左上・右上を見るなどの挙動、顎・額・頭などを掻く、瞬きの回数の増減、心拍数の増減、などの情報を取得し、記録し、かかる状態に基づき、画像内の利用者のストレス状況を示す情報を生成してもよい。かかる生成されたストレス状況を示す情報は、WEB通話機能を利用している他の利用者に伝達されてよい。すなわち、ストレス状況を示す情報は、管理装置を介して、他の利用者に係る利用者端末のWEBブラウザ上で表示されてよい。かかる構成により、利用者は、特に、WEB通話の相手方の画像をリアルタイムに見ることができない場合において、相手の機微に応じたコミュニケーションを可能にできる利点がある。また、仮に利用者が相手方の画像をリアルタイムに見ることができる場合であっても、ストレスを示す情報を参考として、相手の機微に応じたコミュニケーションを可能にできる利点がある。また、かかるストレス状況を示す情報は、管理装置内において統計情報としてストレスを示す情報の所定の期間内の平均値が格納され、利用者に係る端末装置に送信されることで、利用者自身のストレスについての客観的な情報として、利用できる利点がある。また、同様に、かかる管理装置内において統計情報としてストレスを示す情報が所定の条件を充足した場合に、利用者に係る端末装置に警告を送信して利用者に係る端末装置上で自己のストレスの程度が所定の条件を充足したものとして表示されることで、利用者自身が自己のストレスの程度を理解できる利点がある。なお、かかるストレスを示す情報が所定の条件を示した場合に、管理装置に係る管理者端末や利用者のストレス状況を把握することが期待されている立場(本願書類において、「監督者」ということがある)に係る端末装置に対して送信され、表示されることで、監督者に係る利用者が、従業員に係る利用者のストレスの程度の把握に利用可能であってもよい。この場合において、利用者自身が自己のストレスの程度を把握するための所定の条件と、利用者の監督者に係る利用者が従業員に係る利用者のストレスの程度の把握のための所定の条件は、同じであってもよいし、異なってもよい。異なる場合、例えば、監督者に係る利用者が従業員に係る利用者のストレスの程度の把握のための所定の条件は、利用者自身が自己のストレスの程度の把握のための所定の条件と比べて、ストレスの程度が高く設定されてよい。この場合、小さいストレスの程度の段階においては、利用者が自分自身で把握し、生活の見直しなどにより対応する機会を得ることができる一方、高いストレスの程度の段階に至って監督者に係る利用者に連絡が通知された場合は、利用者自身が自ら対応できない状況に至っている可能性が生じて初めて監督者に係る利用者が把握できるという状況を実現できる利点がある。なお、上述において、監督者は、従業員の雇用主であってもよいし、従業員の人事を担当する者であってもよい。また、上述においては、ストレス状態を例として説明を行ったが、それに限らず、WEB通話に対する集中の有無や興味関心の有無などの興味関心の程度を示す情報を生成するのに用いられても良い。例えば、利用者端末に係るWEBブラウザ上で実行されるプログラムに係る一実施形態に係るシステムが、画像と、興味関心の程度を示す情報と、の関係を機械学習済みの機械学習部を有し、WEB通話中に新たに取得した画像に対してかかる機械学習部が適用されることで、WEB通話に対する興味関心の程度を示す情報が生成されてよい。なお、興味関心の程度を示す情報は、例えば、興味関心の程度を示す数値を含んでもよいしランクを含んでもよい。数値は、例えば、興味関心がない状態を0として興味関心がある状態を100とした場合の1乃至100の間の数値等であってよく、ランクは、興味関心の程度を示す低・中・強などの複数のうちの一が指定されるもの等であってよい。かかる興味関心の程度を示す情報も、上述のストレス状況を示す情報に対する情報の処理と同様に処理されてよい。例えば、一の利用者に係る端末装置において、撮像装置で撮像された画像に基づいて生成されたWEB通話中における集中や興味関心の有無などの興味関心の程度の情報が、WEB通話の相手方の利用者に係る端末装置に、管理装置を介して送信され、WEB通話の相手方に係る端末装置に係るWEBブラウザ上で実行するプログラムによってかかる興味関心の程度の情報が表示されることにより、WEB通話に対する一の利用者の興味関心の程度をWEB通話の相手方に係る利用者は理解することができ、相手の機微に応じたコミュニケーションを可能とできる利点がある。
Further, the system according to one embodiment may have a WEB call function. The WEB call may have a normal voice function, but may have a function different from the normal voice function. At this time, the system according to the embodiment may acquire information indicating the stress status of the user in real time based on the acquired image. Here, the information indicating the stress situation may be, for example, a numerical value indicating the degree of stress or a rank. The numerical value may be, for example, a numerical value between 1 and 100 when the stress-free state is 0 and the stress is strong as 100, and the rank may be a plurality of stresses such as low, medium, and strong. It may be the one to which one is specified. The information indicating the stress status is obtained by the system according to the embodiment having a machine learning unit in which the relationship between the image and the information indicating the stress status has been machine-learned and newly acquired during a WEB call. On the other hand, it may be generated by applying such a machine learning unit. Such a machine learning unit can be obtained from an image during a web call, for example, behavior such as the user looking at the upper left / upper right, scratching the chin / forehead / head, increasing / decreasing the number of blinks, increasing / decreasing the heart rate, etc. Information such as the above may be acquired and recorded, and information indicating the stress status of the user in the image may be generated based on such a state. The generated information indicating the stress situation may be transmitted to other users who are using the WEB call function. That is, the information indicating the stress status may be displayed on the WEB browser of the user terminal related to another user via the management device. With such a configuration, the user has an advantage that it is possible to communicate according to the subtleties of the other party, especially when the image of the other party of the WEB call cannot be viewed in real time. Further, even if the user can see the image of the other party in real time, there is an advantage that it is possible to communicate according to the subtleties of the other party by referring to the information indicating stress. In addition, the information indicating the stress status is stored as statistical information in the management device as an average value of the information indicating the stress within a predetermined period, and is transmitted to the terminal device related to the user, so that the user himself / herself can use the information. It has the advantage of being available as objective information about stress. Similarly, when the information indicating stress as statistical information in the management device satisfies a predetermined condition, a warning is sent to the terminal device related to the user and the stress of oneself is sent on the terminal device related to the user. Since the degree of is displayed as satisfying a predetermined condition, there is an advantage that the user himself / herself can understand the degree of his / her own stress. It should be noted that, when the information indicating such stress indicates a predetermined condition, it is expected to grasp the stress status of the administrator terminal and the user related to the management device (referred to as "supervisor" in the documents of the present application). It may be possible for the user related to the supervisor to grasp the degree of stress of the user related to the employee by being transmitted and displayed to the terminal device according to (may). In this case, the prescribed conditions for the user to grasp the degree of his / her own stress and the prescribed conditions for the user pertaining to the supervisor of the user to grasp the degree of stress of the user pertaining to the employee. The conditions may be the same or different. If they are different, for example, the predetermined condition for the user related to the supervisor to grasp the degree of stress of the user related to the employee is the predetermined condition for the user himself / herself to grasp the degree of stress of himself / herself. In comparison, the degree of stress may be set higher. In this case, at the stage of low stress level, the user can grasp by himself / herself and have an opportunity to deal with it by reviewing his / her life, while at the stage of high stress level, the user related to the supervisor. When the contact is notified to, there is an advantage that it is possible to realize a situation in which the user related to the supervisor can grasp the situation only when there is a possibility that the user himself / herself cannot respond. In the above, the supervisor may be the employer of the employee or the person in charge of the personnel affairs of the employee. Further, in the above description, the stress state has been described as an example, but the description is not limited to this, and it may be used to generate information indicating the degree of interest such as the presence or absence of concentration on WEB calls and the presence or absence of interest. good. For example, the system according to an embodiment related to a program executed on a WEB browser related to a user terminal has a machine learning unit in which the relationship between an image and information indicating the degree of interest is machine-learned. By applying the machine learning unit to a newly acquired image during a WEB call, information indicating the degree of interest in the WEB call may be generated. The information indicating the degree of interest may include, for example, a numerical value indicating the degree of interest or a rank. The numerical value may be, for example, a numerical value between 1 and 100 when the state of no interest is 0 and the state of interest is 100, and the rank indicates the degree of interest. It may be one in which one of a plurality of items such as strong is specified. The information indicating the degree of interest may be processed in the same manner as the information processing for the information indicating the stress situation described above. For example, in a terminal device related to one user, information on the degree of interest such as concentration and interest in a web call generated based on an image captured by the image pickup device is information of the other party of the web call. WEB calls are sent to the terminal device related to the user via the management device, and information on the degree of interest is displayed by the program executed on the WEB browser related to the terminal device related to the other party of the WEB call. There is an advantage that the user related to the other party of the WEB call can understand the degree of interest of one user and can communicate according to the subtleties of the other party.
一実施形態のシステムが、各端末装置上で表示される他の画面例としては、例えば、図9のようなものであってもよい。
As another screen example displayed on each terminal device, the system of one embodiment may be, for example, the one shown in FIG.
また、一実施形態のシステムにおいて、管理装置01と、端末装置02と、が各々有するデータの一例を示したのが、図10のようなものであってよい。ここで、管理装置は、一台のみを示しているが、複数あってよい。また、管理装置は、クラウド上で実行される例を示しているが、これに限られない。また、管理装置は、データベースとして、各利用者の状況を示す情報について、現在の情報を有してよい。また、各利用者の状況を示す情報について、過去の情報も有してよい。また、基本情報として、各利用者の、連絡先や氏名などの情報を有してよい。これらのデータベース内の情報は、適宜、端末装置からアクセス可能であって良い。たとえば、一の利用者が、他の利用者への連絡手段を利用する場合において、かかる他の利用者についての電子メールアドレスや電話番号などの情報も、端末装置は、かかるデータベースから、情報を取得してよい。また、これらのデータベースは、リレーショナルデータベースや、オブジェクト指向型データベース等、種々のタイプのデータベースが用いられてよく、その形式や種類に制限はない。
Further, in the system of one embodiment, an example of the data possessed by the management device 01 and the terminal device 02 may be shown as shown in FIG. Here, although only one management device is shown, there may be a plurality of management devices. Further, the management device shows an example of being executed on the cloud, but the present invention is not limited to this. Further, the management device may have the current information as a database about the information indicating the situation of each user. In addition, past information may be included in the information indicating the situation of each user. In addition, as basic information, information such as contact information and name of each user may be included. The information in these databases may be appropriately accessible from the terminal device. For example, when one user uses a means of contacting another user, the terminal device also obtains information such as an e-mail address and a telephone number of the other user from such a database. You may get it. Further, as these databases, various types of databases such as relational databases and object-oriented databases may be used, and the formats and types thereof are not limited.
3.2.実施形態2
実施形態2においては、本願に係る一実施形態に係るシステムを利用する第1利用者が、第1利用者に係る第1端末装置に係る撮像装置の撮像視野内から撮像視野外に移動した場合の流れを、図11を用いて説明する。 3.2.Embodiment 2
In the second embodiment, when the first user who uses the system according to the embodiment according to the present application moves from the image pickup field of view of the image pickup device according to the first terminal device according to the first user to the outside of the image pickup field of view. The flow of the above will be described with reference to FIG.
実施形態2においては、本願に係る一実施形態に係るシステムを利用する第1利用者が、第1利用者に係る第1端末装置に係る撮像装置の撮像視野内から撮像視野外に移動した場合の流れを、図11を用いて説明する。 3.2.
In the second embodiment, when the first user who uses the system according to the embodiment according to the present application moves from the image pickup field of view of the image pickup device according to the first terminal device according to the first user to the outside of the image pickup field of view. The flow of the above will be described with reference to FIG.
本実施形態を用いた態様では、第1利用者は、第1利用者に係る第1端末装置に係る第1撮像装置が、第1利用者を撮像しており、第1撮像装置から画像を取得した第1端末装置内のWEBブラウザ上で実行されているプログラムは、第1撮像装置の撮像視野内に人の顔があることを示す情報を生成し、かかる人の顔があることを示す情報を、利用者動的属性情報内の一情報として、管理装置に送信した。また、管理装置は、かかる第1端末装置から取得した、利用者属性情報の一情報である、利用者動的属性情報の一情報としての人の顔があることを示す情報を、取得し、記憶している。また、かかる管理装置は、第1端末装置と異なる第2端末装置に対して、かかる人の顔があることを示す情報を含む情報を、送信し、第2端末装置内のWEBブラウザ上で実行されているプログラムは、かかる情報を取得し、第2端末装置内のWEBブラウザ上で第1利用者についての人の顔があることを示す情報を用いて、第1利用者が着席している情報を表示している。
In the embodiment using the present embodiment, in the first user, the first image pickup device according to the first terminal device according to the first user is taking an image of the first user, and the image is taken from the first image pickup device. The acquired program executed on the WEB browser in the first terminal device generates information indicating that the image pickup field of the first image pickup device has a person's face, and indicates that the person's face is present. The information was transmitted to the management device as one piece of information in the user dynamic attribute information. Further, the management device acquires information indicating that there is a human face as one piece of user dynamic attribute information, which is one piece of user attribute information acquired from the first terminal device. I remember. Further, the management device transmits information including information indicating that the person has a face to the second terminal device different from the first terminal device, and executes the information on the WEB browser in the second terminal device. The program being executed acquires such information, and the first user is seated using the information indicating that there is a person's face about the first user on the WEB browser in the second terminal device. Information is displayed.
ステップ1.
第1利用者の顔が、第1撮像装置の撮像視野外に出る。この場合、第1撮像装置からかかる第1利用者の顔を含まない画像を取得した、第1端末装置に係るWEBブラウザ上で実行されているプログラムは、かかる画像に基づき、人の顔がないことを示す情報を生成する。なお、かかるプログラムが第1撮像装置から画像を取得するタイミングは、常に動画として取得してもよいし、所定のインターバルで取得してもよい。Step 1.
The face of the first user goes out of the imaging field of view of the first imaging device. In this case, the program executed on the WEB browser according to the first terminal device, which has acquired the image not including the face of the first user from the first image pickup device, has no human face based on the image. Generate information to indicate that. The timing at which the program acquires an image from the first image pickup apparatus may always be acquired as a moving image or may be acquired at a predetermined interval.
第1利用者の顔が、第1撮像装置の撮像視野外に出る。この場合、第1撮像装置からかかる第1利用者の顔を含まない画像を取得した、第1端末装置に係るWEBブラウザ上で実行されているプログラムは、かかる画像に基づき、人の顔がないことを示す情報を生成する。なお、かかるプログラムが第1撮像装置から画像を取得するタイミングは、常に動画として取得してもよいし、所定のインターバルで取得してもよい。
The face of the first user goes out of the imaging field of view of the first imaging device. In this case, the program executed on the WEB browser according to the first terminal device, which has acquired the image not including the face of the first user from the first image pickup device, has no human face based on the image. Generate information to indicate that. The timing at which the program acquires an image from the first image pickup apparatus may always be acquired as a moving image or may be acquired at a predetermined interval.
ステップ2.
かかるプログラムは、人の顔がないことを示す情報を含む情報を、所定のタイミングで、管理装置に送信する。かかる所定のタイミングは、例えば、30秒毎、1分毎、2分毎、3分毎、5分毎、10分毎など比較的短期間で取得する場合、利用者の着席の有無をよりリアルタイムに管理装置へ情報を送信できる利点がある。Step 2.
Such a program transmits information including information indicating that there is no human face to the management device at a predetermined timing. When the predetermined timing is acquired in a relatively short period of time, for example, every 30 seconds, every 1 minute, every 2 minutes, every 3 minutes, every 5 minutes, every 10 minutes, whether or not the user is seated is more real-time. Has the advantage of being able to send information to the management device.
かかるプログラムは、人の顔がないことを示す情報を含む情報を、所定のタイミングで、管理装置に送信する。かかる所定のタイミングは、例えば、30秒毎、1分毎、2分毎、3分毎、5分毎、10分毎など比較的短期間で取得する場合、利用者の着席の有無をよりリアルタイムに管理装置へ情報を送信できる利点がある。
Such a program transmits information including information indicating that there is no human face to the management device at a predetermined timing. When the predetermined timing is acquired in a relatively short period of time, for example, every 30 seconds, every 1 minute, every 2 minutes, every 3 minutes, every 5 minutes, every 10 minutes, whether or not the user is seated is more real-time. Has the advantage of being able to send information to the management device.
ステップ3.
管理装置は、第1利用者について、人の顔がないことを示す情報を記憶し、所定のタイミングで、第1端末装置とは異なる第2端末装置を含む複数の端末装置へ、かかる人の顔がないことを示す情報を含む情報を、送信する。管理装置は、人の顔があることを示す情報から初めて人の顔がないことを示す情報に変更した場合、離席状態の経過時間の測定を始めてよく、また、かかる経過時間を、上述の複数の端末装置に送信してよい。なお、管理装置は、これらの情報を、第1端末装置に対して、同様に送信してもよいし、送信しなくてもよい。Step 3.
The management device stores information indicating that there is no human face for the first user, and at a predetermined timing, the management device transfers the information to a plurality of terminal devices including the second terminal device different from the first terminal device. Send information, including information indicating that there is no face. When the management device changes from the information indicating that there is a human face to the information indicating that there is no human face for the first time, the measurement of the elapsed time of the absence state may be started, and the elapsed time is described above. It may be transmitted to a plurality of terminal devices. The management device may or may not transmit these information to the first terminal device in the same manner.
管理装置は、第1利用者について、人の顔がないことを示す情報を記憶し、所定のタイミングで、第1端末装置とは異なる第2端末装置を含む複数の端末装置へ、かかる人の顔がないことを示す情報を含む情報を、送信する。管理装置は、人の顔があることを示す情報から初めて人の顔がないことを示す情報に変更した場合、離席状態の経過時間の測定を始めてよく、また、かかる経過時間を、上述の複数の端末装置に送信してよい。なお、管理装置は、これらの情報を、第1端末装置に対して、同様に送信してもよいし、送信しなくてもよい。
The management device stores information indicating that there is no human face for the first user, and at a predetermined timing, the management device transfers the information to a plurality of terminal devices including the second terminal device different from the first terminal device. Send information, including information indicating that there is no face. When the management device changes from the information indicating that there is a human face to the information indicating that there is no human face for the first time, the measurement of the elapsed time of the absence state may be started, and the elapsed time is described above. It may be transmitted to a plurality of terminal devices. The management device may or may not transmit these information to the first terminal device in the same manner.
ステップ4.
第2端末装置に係るWEBブラウザ上で実行するプログラムは、かかる第1端末装置に係る人の顔がないことを示す情報を含む情報を取得し、第1利用者と関連付けて例えば離席中である情報として、WEBブラウザ上で表示可能に動作する。なお、かかるプログラムは、人の顔がないことを示す情報を取得した後の経過時間である、離席状態の経過時間の情報を、端末装置から受領した場合、かかるプログラムは、第1利用者と関連付けてかかる経過時間をWEBブラウザ上で表示可能に動作してよい。Step 4 .
The program executed on the WEB browser related to the second terminal device acquires information including information indicating that there is no person's face related to the first terminal device, and associates it with the first user, for example, while away from the desk. As certain information, it operates so that it can be displayed on a WEB browser. In addition, when the information of the elapsed time of the absence state, which is the elapsed time after acquiring the information indicating that there is no human face, is received from the terminal device, the said program is the first user. It may operate so that the elapsed time taken in association with can be displayed on the WEB browser.
第2端末装置に係るWEBブラウザ上で実行するプログラムは、かかる第1端末装置に係る人の顔がないことを示す情報を含む情報を取得し、第1利用者と関連付けて例えば離席中である情報として、WEBブラウザ上で表示可能に動作する。なお、かかるプログラムは、人の顔がないことを示す情報を取得した後の経過時間である、離席状態の経過時間の情報を、端末装置から受領した場合、かかるプログラムは、第1利用者と関連付けてかかる経過時間をWEBブラウザ上で表示可能に動作してよい。
The program executed on the WEB browser related to the second terminal device acquires information including information indicating that there is no person's face related to the first terminal device, and associates it with the first user, for example, while away from the desk. As certain information, it operates so that it can be displayed on a WEB browser. In addition, when the information of the elapsed time of the absence state, which is the elapsed time after acquiring the information indicating that there is no human face, is received from the terminal device, the said program is the first user. It may operate so that the elapsed time taken in association with can be displayed on the WEB browser.
ステップ5.
第2端末装置に係る第2利用者は、第1利用者が離席状態であることの表示を見ることができ、かかる状態を踏まえて、第2利用者に対するコミュニケーションを検討できる利点がある。また、第2端末装置に係るWEBブラウザ上で、第1利用者の離席の経過時間が表示された場合、第2利用者は、第1利用者の状況を推定してコミュニケーションを検討できる利点がある。例えば、就業開始時間後1時間の段階で、第1利用者の離席時間が60分であれば、出張、フレックス、お休みなどが考えられるが、15分以内であれば休憩などとも考えられる。同様に、お昼時において、第1利用者の離席時間が30分以上であれば食事に出かけた可能性が考えられるが、第1利用者の離席時間が15分以内であれば時刻にもよるが直に戻ってくる可能性も考えられる。Step 5 .
The second user related to the second terminal device can see the display that the first user is away from his / her seat, and has an advantage that he / she can consider communication with the second user based on such a state. Further, when the elapsed time of leaving the seat of the first user is displayed on the WEB browser related to the second terminal device, the second user can estimate the situation of the first user and consider communication. There is. For example, if the first user's absence time is 60 minutes at the stage of 1 hour after the start of work, a business trip, flex, or a break may be considered, but if it is within 15 minutes, a break may be considered. .. Similarly, at noon, if the first user's leave time is 30 minutes or more, it is possible that he went out to eat, but if the first user's leave time is within 15 minutes, the time is reached. Depending on the situation, there is a possibility that it will come back soon.
第2端末装置に係る第2利用者は、第1利用者が離席状態であることの表示を見ることができ、かかる状態を踏まえて、第2利用者に対するコミュニケーションを検討できる利点がある。また、第2端末装置に係るWEBブラウザ上で、第1利用者の離席の経過時間が表示された場合、第2利用者は、第1利用者の状況を推定してコミュニケーションを検討できる利点がある。例えば、就業開始時間後1時間の段階で、第1利用者の離席時間が60分であれば、出張、フレックス、お休みなどが考えられるが、15分以内であれば休憩などとも考えられる。同様に、お昼時において、第1利用者の離席時間が30分以上であれば食事に出かけた可能性が考えられるが、第1利用者の離席時間が15分以内であれば時刻にもよるが直に戻ってくる可能性も考えられる。
The second user related to the second terminal device can see the display that the first user is away from his / her seat, and has an advantage that he / she can consider communication with the second user based on such a state. Further, when the elapsed time of leaving the seat of the first user is displayed on the WEB browser related to the second terminal device, the second user can estimate the situation of the first user and consider communication. There is. For example, if the first user's absence time is 60 minutes at the stage of 1 hour after the start of work, a business trip, flex, or a break may be considered, but if it is within 15 minutes, a break may be considered. .. Similarly, at noon, if the first user's leave time is 30 minutes or more, it is possible that he went out to eat, but if the first user's leave time is within 15 minutes, the time is reached. Depending on the situation, there is a possibility that it will come back soon.
3.3.実施形態3
実施形態3においては、本願に係る一実施形態に係るシステムを利用する第1利用者が、第1利用者に係る端末装置に係る撮像装置を用いて、WEB会議を行う場合の流れを、図12を用いて説明する。本実施形態においても、上述の実施形態2と同じ状態であるとする。 3.3.Embodiment 3
In the third embodiment, the flow in which the first user who uses the system according to the embodiment according to the present application holds a WEB conference using the image pickup device according to the terminal device according to the first user is shown in the figure. 12 will be described. Also in this embodiment, it is assumed that the state is the same as that in the above-mentioned second embodiment.
実施形態3においては、本願に係る一実施形態に係るシステムを利用する第1利用者が、第1利用者に係る端末装置に係る撮像装置を用いて、WEB会議を行う場合の流れを、図12を用いて説明する。本実施形態においても、上述の実施形態2と同じ状態であるとする。 3.3.
In the third embodiment, the flow in which the first user who uses the system according to the embodiment according to the present application holds a WEB conference using the image pickup device according to the terminal device according to the first user is shown in the figure. 12 will be described. Also in this embodiment, it is assumed that the state is the same as that in the above-mentioned second embodiment.
ステップ1
まず、第1利用者が、WEB会議時間の直前になった段階で、第1端末装置に係るWEBブラウザ上に表示されているWEB会議ボタンに対して入力をする。第1端末装置に係るブラウザ上で実行されているプログラムは、かかるWEB会議ボタンの入力を受け付け、第1撮像装置に対するアクセスを停止し、第1撮像装置からの画像の取得を停止する。かかるプログラムは、WEB会議ボタンの入力を受け付けると同時に時間の計測を開始する。かかる時間の計測は、第1撮像装置へのアクセスを再開するための条件を判定するために使用される。かかるプログラムは、第1撮像装置へのアクセスを再開する条件である第1所定の時間の経過まで、第1撮像装置へのアクセスを停止する。この第1所定の時間、第1端末装置内のアプリケーションは、第1撮像装置に対するアクセスの取得が可能となるため、第1利用者は、少なくとも第1所定の期間は、WEB会議の準備の猶予がある。Step 1
First, the first user inputs an input to the WEB conference button displayed on the WEB browser related to the first terminal device at the stage immediately before the WEB conference time. The program executed on the browser related to the first terminal device accepts the input of the WEB conference button, stops the access to the first image pickup device, and stops the acquisition of the image from the first image pickup device. Such a program starts measuring the time at the same time as accepting the input of the WEB conference button. The measurement of such time is used to determine the conditions for resuming access to the first image pickup apparatus. Such a program suspends access to the first image pickup apparatus until the lapse of a first predetermined time, which is a condition for resuming access to the first image pickup apparatus. During this first predetermined time, the application in the first terminal device can acquire access to the first image pickup device, so that the first user has a grace period for preparing for the WEB conference at least for the first predetermined period. There is.
まず、第1利用者が、WEB会議時間の直前になった段階で、第1端末装置に係るWEBブラウザ上に表示されているWEB会議ボタンに対して入力をする。第1端末装置に係るブラウザ上で実行されているプログラムは、かかるWEB会議ボタンの入力を受け付け、第1撮像装置に対するアクセスを停止し、第1撮像装置からの画像の取得を停止する。かかるプログラムは、WEB会議ボタンの入力を受け付けると同時に時間の計測を開始する。かかる時間の計測は、第1撮像装置へのアクセスを再開するための条件を判定するために使用される。かかるプログラムは、第1撮像装置へのアクセスを再開する条件である第1所定の時間の経過まで、第1撮像装置へのアクセスを停止する。この第1所定の時間、第1端末装置内のアプリケーションは、第1撮像装置に対するアクセスの取得が可能となるため、第1利用者は、少なくとも第1所定の期間は、WEB会議の準備の猶予がある。
First, the first user inputs an input to the WEB conference button displayed on the WEB browser related to the first terminal device at the stage immediately before the WEB conference time. The program executed on the browser related to the first terminal device accepts the input of the WEB conference button, stops the access to the first image pickup device, and stops the acquisition of the image from the first image pickup device. Such a program starts measuring the time at the same time as accepting the input of the WEB conference button. The measurement of such time is used to determine the conditions for resuming access to the first image pickup apparatus. Such a program suspends access to the first image pickup apparatus until the lapse of a first predetermined time, which is a condition for resuming access to the first image pickup apparatus. During this first predetermined time, the application in the first terminal device can acquire access to the first image pickup device, so that the first user has a grace period for preparing for the WEB conference at least for the first predetermined period. There is.
ステップ2
第1利用者は、WEB会議を始める。このとき、上述のプログラムは第1撮像装置に対してアクセスしていないことから、WEB会議に係るアプリケーションを含む第1撮像装置内の任意のアプリケーションが、第1撮像装置のアクセスが可能である。なお、本願書類において、撮像装置のアクセスが可能である、とは、撮像装置を制御する権限を有することを意味してよい。なお、後述の通り、上述のプログラムは、第1所定の期間経過後、第2所定の期間毎に、第1撮像装置にアクセスを試みることから、第1所定の期間経過時に第1利用者がWEB会議を開始していない場合、又は、第1所定の期間及び第2所定の期間の経過時に第1利用者がWEB会議を開始していない場合、上述のプログラムが第1撮像装置のアクセス権限を取得するため、このような場合、WEB会議を始める予定の第1利用者は、上述のステップ1に戻り、再度、WEB会議ボタンに対して入力をする必要がある。Step 2
The first user starts a WEB conference. At this time, since the above-mentioned program does not access the first image pickup device, any application in the first image pickup device including the application related to the WEB conference can access the first image pickup device. In the document of the present application, "accessible to the image pickup device" may mean having the authority to control the image pickup device. As will be described later, since the above-mentioned program attempts to access the first imaging device every second predetermined period after the lapse of the first predetermined period, the first user will try to access the first predetermined period after the lapse of the first predetermined period. If the WEB conference has not started, or if the first user has not started the WEB conference after the lapse of the first predetermined period and the second predetermined period, the above program has the access authority of the first image pickup device. In such a case, the first user who plans to start the WEB conference needs to return tostep 1 described above and input to the WEB conference button again.
第1利用者は、WEB会議を始める。このとき、上述のプログラムは第1撮像装置に対してアクセスしていないことから、WEB会議に係るアプリケーションを含む第1撮像装置内の任意のアプリケーションが、第1撮像装置のアクセスが可能である。なお、本願書類において、撮像装置のアクセスが可能である、とは、撮像装置を制御する権限を有することを意味してよい。なお、後述の通り、上述のプログラムは、第1所定の期間経過後、第2所定の期間毎に、第1撮像装置にアクセスを試みることから、第1所定の期間経過時に第1利用者がWEB会議を開始していない場合、又は、第1所定の期間及び第2所定の期間の経過時に第1利用者がWEB会議を開始していない場合、上述のプログラムが第1撮像装置のアクセス権限を取得するため、このような場合、WEB会議を始める予定の第1利用者は、上述のステップ1に戻り、再度、WEB会議ボタンに対して入力をする必要がある。
The first user starts a WEB conference. At this time, since the above-mentioned program does not access the first image pickup device, any application in the first image pickup device including the application related to the WEB conference can access the first image pickup device. In the document of the present application, "accessible to the image pickup device" may mean having the authority to control the image pickup device. As will be described later, since the above-mentioned program attempts to access the first imaging device every second predetermined period after the lapse of the first predetermined period, the first user will try to access the first predetermined period after the lapse of the first predetermined period. If the WEB conference has not started, or if the first user has not started the WEB conference after the lapse of the first predetermined period and the second predetermined period, the above program has the access authority of the first image pickup device. In such a case, the first user who plans to start the WEB conference needs to return to
ステップ3
プログラムは、第1所定の期間経過後、第2所定の期間毎に、第1撮像装置に対するアクセスが可能であるかどうかを試みる。アクセスが可能である状態、すなわち、第1撮像装置を制御する権限が得られる状態であれば、上述のプログラムは、権限を取得する。Step 3
The program attempts to access the first imaging device every second predetermined period after the lapse of the first predetermined period. The above-mentioned program acquires the authority if the access is possible, that is, the authority to control the first image pickup apparatus is obtained.
プログラムは、第1所定の期間経過後、第2所定の期間毎に、第1撮像装置に対するアクセスが可能であるかどうかを試みる。アクセスが可能である状態、すなわち、第1撮像装置を制御する権限が得られる状態であれば、上述のプログラムは、権限を取得する。
The program attempts to access the first imaging device every second predetermined period after the lapse of the first predetermined period. The above-mentioned program acquires the authority if the access is possible, that is, the authority to control the first image pickup apparatus is obtained.
ステップ4
第1利用者がWEB会議終了する。かかるWEB会議の終了により、WEB会議に係るアプリケーションは、第1撮像装置に対するアクセス権限を放棄するため、上述の第1所定の期間の経過後であって、第2所定の期間毎のタイミングで、上述のプログラムは、第1撮像装置に係るアクセス権限を取得する。プログラムが、第2所定の期間毎に第1撮像装置へのアクセスを試みることにより、仮に第1利用者が第1撮像装置を上述のプログラムにおいて利用するよう設定することを失念しても、自動的に、上述のプログラムが第1撮像装置へのアクセスを試みて取得し、第1利用者の着席又は離席状態を検知可能な状態にできる利点がある。Step 4
The first user ends the WEB conference. Due to the termination of the WEB conference, the application related to the WEB conference relinquishes the access authority to the first imaging device, so that after the lapse of the above-mentioned first predetermined period and at the timing of each second predetermined period. The above-mentioned program acquires the access authority related to the first image pickup apparatus. Even if the program attempts to access the first image pickup device every second predetermined period, even if the first user forgets to set the first image pickup device to be used in the above-mentioned program, it is automatically performed. Therefore, there is an advantage that the above-mentioned program can attempt to acquire access to the first image pickup apparatus and make it possible to detect the seated or absent state of the first user.
第1利用者がWEB会議終了する。かかるWEB会議の終了により、WEB会議に係るアプリケーションは、第1撮像装置に対するアクセス権限を放棄するため、上述の第1所定の期間の経過後であって、第2所定の期間毎のタイミングで、上述のプログラムは、第1撮像装置に係るアクセス権限を取得する。プログラムが、第2所定の期間毎に第1撮像装置へのアクセスを試みることにより、仮に第1利用者が第1撮像装置を上述のプログラムにおいて利用するよう設定することを失念しても、自動的に、上述のプログラムが第1撮像装置へのアクセスを試みて取得し、第1利用者の着席又は離席状態を検知可能な状態にできる利点がある。
The first user ends the WEB conference. Due to the termination of the WEB conference, the application related to the WEB conference relinquishes the access authority to the first imaging device, so that after the lapse of the above-mentioned first predetermined period and at the timing of each second predetermined period. The above-mentioned program acquires the access authority related to the first image pickup apparatus. Even if the program attempts to access the first image pickup device every second predetermined period, even if the first user forgets to set the first image pickup device to be used in the above-mentioned program, it is automatically performed. Therefore, there is an advantage that the above-mentioned program can attempt to acquire access to the first image pickup apparatus and make it possible to detect the seated or absent state of the first user.
なお、図13は、上述のプログラムが、第1撮像装置に対するアクセスを試みるロジックを説明する一例の図である。上述のプログラムが、(1)第1撮像装置に対して第2所定の期間毎にカメラの接続状況を確認し、(2)未接続であれば撮像装置をイニシャライズし、(3)イニシャライズの成功時及び既に接続済みであれば画像に対してAI処理を行い、(4)イニシャライズに失敗した場合(例えば、他のWEB会議アプリケーションが第1撮像装置を利用している場合等)にはこれを記録して(1)に戻る、などの処理が進められてよい。
Note that FIG. 13 is an example diagram illustrating the logic by which the above-mentioned program attempts to access the first image pickup apparatus. The above program (1) confirms the connection status of the camera to the first image pickup device every second predetermined period, (2) initializes the image pickup device if it is not connected, and (3) succeeds in initialization. At the time and if it is already connected, AI processing is performed on the image, and (4) if initialization fails (for example, when another WEB conference application uses the first image pickup device), this is performed. Processing such as recording and returning to (1) may proceed.
3.4.実施形態4
実施形態4においては、本願に係る一実施形態に係るシステムを利用する第1利用者が、集中したい場合の流れについて図14を用いて説明する。
本実施形態においても、上述の実施形態2と同じ状態であるとする。 3.4.Embodiment 4
In the fourth embodiment, the flow when the first user who uses the system according to the one embodiment according to the present application wants to concentrate will be described with reference to FIG.
Also in this embodiment, it is assumed that the state is the same as that in the above-mentioned second embodiment.
実施形態4においては、本願に係る一実施形態に係るシステムを利用する第1利用者が、集中したい場合の流れについて図14を用いて説明する。
本実施形態においても、上述の実施形態2と同じ状態であるとする。 3.4.
In the fourth embodiment, the flow when the first user who uses the system according to the one embodiment according to the present application wants to concentrate will be described with reference to FIG.
Also in this embodiment, it is assumed that the state is the same as that in the above-mentioned second embodiment.
ステップ1.
まず、第1利用者が、集中したい場合に、第1端末装置に係るWEBブラウザ上に表示されている集中モードに対して入力をする。第1端末装置に係るブラウザ上で実行されているプログラムは、かかる集中モードの入力を受け付ける。Step 1.
First, when the first user wants to concentrate, he / she inputs to the centralized mode displayed on the WEB browser related to the first terminal device. The program executed on the browser related to the first terminal device accepts the input of the centralized mode.
まず、第1利用者が、集中したい場合に、第1端末装置に係るWEBブラウザ上に表示されている集中モードに対して入力をする。第1端末装置に係るブラウザ上で実行されているプログラムは、かかる集中モードの入力を受け付ける。
First, when the first user wants to concentrate, he / she inputs to the centralized mode displayed on the WEB browser related to the first terminal device. The program executed on the browser related to the first terminal device accepts the input of the centralized mode.
ステップ2.
かかるプログラムは、集中モードであることを示す情報を含む情報を、所定のタイミングで、管理装置に送信する。かかる所定のタイミングは、例えば、30秒毎、1分毎、2分毎、3分毎、5分毎、10分毎など比較的短期間で送信する場合、第1利用者が集中モードとなった情報を、よりリアルタイムに管理装置へ情報を送信できる利点がある。Step 2.
Such a program transmits information including information indicating that it is in the centralized mode to the management device at a predetermined timing. When the predetermined timing is transmitted in a relatively short period of time, for example, every 30 seconds, every 1 minute, every 2 minutes, every 3 minutes, every 5 minutes, every 10 minutes, the first user is in the centralized mode. There is an advantage that the information can be transmitted to the management device in real time.
かかるプログラムは、集中モードであることを示す情報を含む情報を、所定のタイミングで、管理装置に送信する。かかる所定のタイミングは、例えば、30秒毎、1分毎、2分毎、3分毎、5分毎、10分毎など比較的短期間で送信する場合、第1利用者が集中モードとなった情報を、よりリアルタイムに管理装置へ情報を送信できる利点がある。
Such a program transmits information including information indicating that it is in the centralized mode to the management device at a predetermined timing. When the predetermined timing is transmitted in a relatively short period of time, for example, every 30 seconds, every 1 minute, every 2 minutes, every 3 minutes, every 5 minutes, every 10 minutes, the first user is in the centralized mode. There is an advantage that the information can be transmitted to the management device in real time.
ステップ3.
管理装置は、第1利用者について、集中モードであることを示す情報を記憶し、所定のタイミングで、第1端末装置とは異なる第2端末装置を含む複数の端末装置へ、第1利用者が集中モードであることを示す情報を含む情報を、送信する。なお、管理装置は、これらの情報を、第1端末装置に対して、同様に送信してもよいし、送信しなくてもよい。Step 3.
The management device stores information indicating that the first user is in the centralized mode, and at a predetermined timing, the first user is sent to a plurality of terminal devices including the second terminal device different from the first terminal device. Sends information, including information indicating that is in centralized mode. The management device may or may not transmit these information to the first terminal device in the same manner.
管理装置は、第1利用者について、集中モードであることを示す情報を記憶し、所定のタイミングで、第1端末装置とは異なる第2端末装置を含む複数の端末装置へ、第1利用者が集中モードであることを示す情報を含む情報を、送信する。なお、管理装置は、これらの情報を、第1端末装置に対して、同様に送信してもよいし、送信しなくてもよい。
The management device stores information indicating that the first user is in the centralized mode, and at a predetermined timing, the first user is sent to a plurality of terminal devices including the second terminal device different from the first terminal device. Sends information, including information indicating that is in centralized mode. The management device may or may not transmit these information to the first terminal device in the same manner.
ステップ4.
第2端末装置に係るWEBブラウザ上で実行するプログラムは、かかる第1端末装置に係る集中モードであることを示す情報を含む情報を取得し、第1利用者と関連付けて例えば集中モードである情報として、WEBブラウザ上で表示可能に動作する。Step 4.
The program executed on the WEB browser related to the second terminal device acquires information including information indicating that it is in the centralized mode related to the first terminal device, and associates it with the first user, for example, information in the centralized mode. It works so that it can be displayed on the WEB browser.
第2端末装置に係るWEBブラウザ上で実行するプログラムは、かかる第1端末装置に係る集中モードであることを示す情報を含む情報を取得し、第1利用者と関連付けて例えば集中モードである情報として、WEBブラウザ上で表示可能に動作する。
The program executed on the WEB browser related to the second terminal device acquires information including information indicating that it is in the centralized mode related to the first terminal device, and associates it with the first user, for example, information in the centralized mode. It works so that it can be displayed on the WEB browser.
3.5.実施形態5
実施形態5は、その他の実施形態である。例えば、上述において、利用者は、特定の一の団体に所属する場合を説明したが、特定の一の団体に限定されず、複数の特定の団体に各々一又は複数の利用者が所属する状況における各利用者間において、一実施形態のシステムは利用されてよい。この場合、利用者は、複数の団体の一部に所属する利用者であってよい。特に、特定の団体の外の団体との関係性において、各団体の構成員が、日常の会話や通常の雑談を積極的に行うことによって、シナジーが増加されるなどの利点が挙げられる。複数の団体における、各利用者が、互いに交流するケースとしては、例えば、共同研究の研究員同士の雑談を含めた交流であったり、ビジネスアライアンスの締結中の関係者などであってもよい。 3.5.Embodiment 5
The fifth embodiment is another embodiment. For example, in the above, the case where the user belongs to one specific group has been described, but the situation is not limited to one specific group, and one or more users belong to each of a plurality of specific groups. The system of one embodiment may be used among the users in the above. In this case, the user may be a user who belongs to a part of a plurality of organizations. In particular, in relation to an organization other than a specific organization, there is an advantage that synergies are increased by having members of each organization actively engage in daily conversations and ordinary chats. Cases in which each user in a plurality of organizations interacts with each other may be, for example, an exchange including a chat between researchers in joint research, or a related person who is in the process of concluding a business alliance.
実施形態5は、その他の実施形態である。例えば、上述において、利用者は、特定の一の団体に所属する場合を説明したが、特定の一の団体に限定されず、複数の特定の団体に各々一又は複数の利用者が所属する状況における各利用者間において、一実施形態のシステムは利用されてよい。この場合、利用者は、複数の団体の一部に所属する利用者であってよい。特に、特定の団体の外の団体との関係性において、各団体の構成員が、日常の会話や通常の雑談を積極的に行うことによって、シナジーが増加されるなどの利点が挙げられる。複数の団体における、各利用者が、互いに交流するケースとしては、例えば、共同研究の研究員同士の雑談を含めた交流であったり、ビジネスアライアンスの締結中の関係者などであってもよい。 3.5.
The fifth embodiment is another embodiment. For example, in the above, the case where the user belongs to one specific group has been described, but the situation is not limited to one specific group, and one or more users belong to each of a plurality of specific groups. The system of one embodiment may be used among the users in the above. In this case, the user may be a user who belongs to a part of a plurality of organizations. In particular, in relation to an organization other than a specific organization, there is an advantage that synergies are increased by having members of each organization actively engage in daily conversations and ordinary chats. Cases in which each user in a plurality of organizations interacts with each other may be, for example, an exchange including a chat between researchers in joint research, or a related person who is in the process of concluding a business alliance.
また、利用者は、シェアオフィスなどの現実空間においても、一実施形態のシステムが利用されてもよい。例えば、シェアオフィスにおいて、各々が情報処理装置を用いて業務をしている中で、上述の通り、各利用者に係る情報処理装置の一は、例えば、その無線通信に係るWIFIの技術などを用いて具体的な位置を特定可能である。そのため、たとえば、シェアオフィス内における各利用者の位置を表示しつつ、各利用者の所属や専門などを一定の範囲で開示して、各利用者間で共有して、互いに情報を取得できるようにしてもよい。かかる構成の場合、シェアオフィスなどの現実空間において、気になる業種や専門を有する他の利用者が近くにいることが判明するため、各利用者は、ビジネスアライアンスの機会などを活用できる利点がある。この場合、各利用者に関する情報として、外部又はかかるシェアオフィス内に開示可能な情報を登録して共有できるようにしてよい。開示可能な情報としては、利用者の氏名、専門、興味範囲、などが挙げられる。これらの情報をシェアオフィス内等の所定の範囲に開示してアクセス可能とすることにより、他の利用者からのアクセスの機会を増加できる利点がある。
Further, the user may use the system of one embodiment even in a real space such as a shared office. For example, in a shared office, while each person is working using an information processing device, as described above, one of the information processing devices related to each user is, for example, WIFI technology related to the wireless communication. The specific position can be specified by using. Therefore, for example, while displaying the position of each user in the shared office, the affiliation and specialty of each user can be disclosed to a certain extent, shared among each user, and information can be obtained from each other. You may do it. In the case of such a configuration, in a real space such as a shared office, it is found that other users with an industry or specialty of interest are nearby, so each user has the advantage of being able to take advantage of opportunities such as business alliances. be. In this case, as information about each user, information that can be disclosed may be registered and shared externally or in such a shared office. Information that can be disclosed includes the user's name, specialty, range of interest, and the like. By disclosing this information to a predetermined range such as in a shared office and making it accessible, there is an advantage that the opportunity for access from other users can be increased.
一実施形態のシステムは、一の利用者によるコミュニケーションを希望している情報情報を共有する機能を有してよい。より具体的には、一の利用者は、WEBブラウザ上の上述のプログラムに対して、コミュニケーションを希望することを示す情報を入力してよい。上述のプログラムは、かかるコミュニケーションを希望することを示す情報の入力を受け付け、所定のタイミングで、管理装置に送信してよい。管理装置は、所定の範囲内の端末装置に、かかる一の利用者と関連付けられたコミュニケーションを希望している情報を送信してよい。かかる所定の範囲は、例えば、一のシェアオフィス内でもよいし、その一部でもよいし、複数のシェアオフィスでもよい。シェアオフィス内の階毎や部屋毎に区切られていてもよい。かかる一の利用者と関連付けられたコミュニケーションを希望している情報は、上述の所定の範囲内の利用者端末上のWEBブラウザ内で実行されている上述のプログラムの動作によって表示されてよく、これにより、かかる所定の範囲内の利用者は、上述の一の利用者がコミュニケーションを希望していることを理解できてよい。これにより、希望する者は、コミュニケーションを、一実施形態のシステムを用いて開始してもよいし、直接現実空間においてコミュニケーションとってもよい。なお、上述のコミュニケーションを希望する旨と関連付けて、例えば、仮想空間上でのコミュニケーションのみを希望するか、現実空間上でのコミュニケーションのみを希望するか、これらのどちらでもよいか、を選択可能であり、かつかかる情報も同様に他の利用者端末に表示できるよう共有されてよい。また、同様に、コミュニケーションの対象やコメントも関連付けられてもよい。コミュニケーションの対象としては、例えば、特定のビジネスに関連する話題であったり、特定の研究分野に関連するものであったりしてよい。
The system of one embodiment may have a function of sharing information that one user wants to communicate with. More specifically, one user may input information indicating that he / she wants to communicate with the above-mentioned program on the WEB browser. The above-mentioned program may accept input of information indicating that such communication is desired and transmit it to the management device at a predetermined timing. The management device may transmit information desired for communication associated with such a user to a terminal device within a predetermined range. The predetermined range may be, for example, one shared office, a part thereof, or a plurality of shared offices. It may be separated by floor or room in the shared office. The information desired to communicate with such one user may be displayed by the operation of the above-mentioned program executed in the WEB browser on the user terminal within the above-mentioned predetermined range. Therefore, the user within the predetermined range may understand that one of the above-mentioned users wants to communicate. Thereby, the person who desires may start the communication by using the system of one embodiment, or may directly communicate in the real space. In addition, in relation to the above-mentioned desire for communication, for example, it is possible to select whether to desire only communication in the virtual space, only communication in the real space, or either of these. Yes, and such information may be shared so that it can be displayed on other user terminals as well. Similarly, the object of communication and comments may also be associated. The subject of communication may be, for example, a topic related to a specific business or a topic related to a specific research field.
また、一の実施形態に係るシステムは、利用者間のマッチング機能を有してもよい。マッチング機能は、利用者の現在の状況を示す情報に基づいて、マッチングをしてもよい。また、かかる場合、現在の状況を示す情報は、例えば、コミュニケーションを希望する、ことを示す情報であってよい。上述の通り、コミュニケーションを希望している情報は、各利用者端末において入力され、管理端末に送信されてよい。かかる管理端末において、コミュニケーションを希望しているとの情報と関連付けられている利用者同士を関連付けることにより、コミュニケーションを希望している利用者間のマッチングを行ってよい。かかるマッチングがされた場合は、マッチング対象の利用者各々に対して、互いにコミュニケーションを希望している者であることを、各利用者端末のWEBブラウザ上で実行されているプログラムの動作によって、表示してよい。この場合、更にSNS等の他のコミュニケーションツールを動作させ、コミュニケーションを希望している利用者同士の専用のコミュニケーション方法を提供するよう動作してもよい。
Further, the system according to one embodiment may have a matching function between users. The matching function may perform matching based on the information indicating the current situation of the user. Further, in such a case, the information indicating the current situation may be, for example, information indicating that communication is desired. As described above, the information desired to be communicated may be input in each user terminal and transmitted to the management terminal. In such a management terminal, matching may be performed between users who desire communication by associating users who are associated with information that they desire communication. When such matching is performed, it is displayed to each user to be matched that they want to communicate with each other by the operation of the program executed on the WEB browser of each user terminal. You can do it. In this case, another communication tool such as SNS may be further operated to provide a dedicated communication method between users who desire communication.
4.システムを構成するハードウェア構成
本願発明に係るシステムは、一又は複数の情報処理装置から構成されてよい。本願発明に係る情報処理装置10は、図20のように、バス15、演算装置11、記憶装置12、及び通信装置16を備えてよい。また、一実施態様における情報処理装置10は、入力装置13、表示装置14を備えてよい。また、ネットワーク17と、直接または間接的に接続される。 4. Hardware Configuration Constituting a System The system according to the present invention may be composed of one or a plurality of information processing devices. As shown in FIG. 20, theinformation processing device 10 according to the present invention may include a bus 15, an arithmetic unit 11, a storage device 12, and a communication device 16. Further, the information processing device 10 in one embodiment may include an input device 13 and a display device 14. It is also directly or indirectly connected to the network 17.
本願発明に係るシステムは、一又は複数の情報処理装置から構成されてよい。本願発明に係る情報処理装置10は、図20のように、バス15、演算装置11、記憶装置12、及び通信装置16を備えてよい。また、一実施態様における情報処理装置10は、入力装置13、表示装置14を備えてよい。また、ネットワーク17と、直接または間接的に接続される。 4. Hardware Configuration Constituting a System The system according to the present invention may be composed of one or a plurality of information processing devices. As shown in FIG. 20, the
バス15は、演算装置11、記憶装置12、入力装置13、表示装置14及び通信装置16の間の情報を伝達する機能を有してよい。
The bus 15 may have a function of transmitting information between the arithmetic unit 11, the storage device 12, the input device 13, the display device 14, and the communication device 16.
演算装置11の例としては、例えばプロセッサが挙げられる。これは、CPUであってもよいし、MPUであってもよい。また、一実施態様における演算装置は、グラフィックスプロセッシングユニット、デジタルシグナルプロセッサなどを有してもよい。要するに、演算装置12は、プログラムの命令を実行できる装置であればよい。
An example of the arithmetic unit 11 is a processor. This may be a CPU or an MPU. Further, the arithmetic unit in one embodiment may include a graphics processing unit, a digital signal processor, and the like. In short, the arithmetic unit 12 may be any device that can execute the instructions of the program.
記憶装置12は、情報を記録する装置である。これは、外部メモリと内部メモリのいずれでもよく、主記憶装置と補助記憶装置のいずれでもよい。また、磁気ディスク(ハードディスク)、光ディスク、磁気テープ、半導体メモリなどでもよい。また、ネットワークを介した記憶装置又は、ネットワークを介したクラウド上の記憶装置を有してもよい。
The storage device 12 is a device for recording information. This may be either an external memory or an internal memory, and may be either a main storage device or an auxiliary storage device. Further, a magnetic disk (hard disk), an optical disk, a magnetic tape, a semiconductor memory, or the like may be used. Further, it may have a storage device via a network or a storage device on the cloud via a network.
なお、演算装置に物理的に近い位置で情報を記憶する、レジスタ、L1キャッシュ、L2キャッシュなどは、本ブロック図においては、演算装置11内に含まれる場合もあるが、計算機アーキテクチャのデザインにおいて、情報を記録する装置としては、記憶装置12がこれらを含んでもよい。要するに、演算装置11、記憶装置12及びバス11が協調して、情報処理を実行できるよう構成されていればよい。
In this block diagram, the registers, L1 cache, L2 cache, etc. that store information at a position physically close to the arithmetic unit may be included in the arithmetic unit 11, but in the design of the computer architecture, As a device for recording information, the storage device 12 may include these. In short, the arithmetic unit 11, the storage device 12, and the bus 11 may be configured to cooperate with each other to execute information processing.
記憶装置12は、本願発明に係る処理を実行可能なプログラムの一部又は全部を備えることができる。また、本願発明に係る処理を実行する際に必要なデータを、適宜記録することもできる。また、一実施態様における記憶装置12は、データベースを含んでもよい。
The storage device 12 can include a part or all of a program capable of executing the process according to the present invention. In addition, data necessary for executing the process according to the present invention can be appropriately recorded. Further, the storage device 12 in one embodiment may include a database.
また、上記は、演算装置12が、記憶装置13に備えられたプログラムに基づいて実行される場合を記載したが、上記のバス11、演算装置12と記憶装置13が組み合わされた形式の一つとして、本願発明に係る情報処理の一部又は全部を、ハードウェア回路自体を変更することができるプログラマブルロジックデバイス又は実行する情報処理が決まっている専用回路で実現されてもよい。
Further, the above describes the case where the arithmetic unit 12 is executed based on the program provided in the storage device 13, but it is one of the forms in which the bus 11, the arithmetic unit 12 and the storage device 13 are combined. As a result, part or all of the information processing according to the present invention may be realized by a programmable logic device capable of changing the hardware circuit itself or a dedicated circuit in which the information processing to be executed is determined.
入力装置13は、情報を入力するものであるが、他の機能を有してもよい。入力装置14としては、キーボード、マウス、タッチパネル、又はペン型の指示装置などの入力装置が挙げられる。
The input device 13 inputs information, but may have other functions. Examples of the input device 14 include an input device such as a keyboard, a mouse, a touch panel, or a pen-type instruction device.
表示装置14は、情報を表示する機能を有する。例えば、液晶ディスプレイ、プラズマディスプレイ、有機ELディスプレイなどが挙げられるが、要するに、情報を表示できる装置であればよい。また、タッチパネルのように入力装置13を一部に備えてもよい。
The display device 14 has a function of displaying information. For example, a liquid crystal display, a plasma display, an organic EL display, and the like can be mentioned, but in short, any device that can display information may be used. Further, the input device 13 may be partially provided like a touch panel.
ネットワーク17は、通信装置16と共に、情報を伝達する。すなわち、情報処理装置である10の情報を、ネットワーク17を介して他の情報端末(図示しない)に伝達できるようにする機能を有する。通信装置16は、どのような接続形式を用いてもよく、IEEE1394、イーサネット(登録商標)、PCI、SCSI、USB、2G、3G、4G、5Gなどでもよい。ネットワーク17への接続は、有線と無線のいずれでもよい。
The network 17 transmits information together with the communication device 16. That is, it has a function of transmitting information of 10 which is an information processing device to another information terminal (not shown) via a network 17. The communication device 16 may use any connection type, and may be IEEE1394, Ethernet (registered trademark), PCI, SCSI, USB, 2G, 3G, 4G, 5G, or the like. The connection to the network 17 may be either wired or wireless.
本願発明に係る情報処理装置は、汎用型であってもよいし、専用型であってもよい。また、当該情報処理装置は、ワークステーション、デスクトップパソコン、ラップトップパソコン、ノートパソコン、PDA、携帯電話、スマートフォンなどでもよい。
The information processing device according to the present invention may be a general-purpose type or a dedicated type. Further, the information processing device may be a workstation, a desktop personal computer, a laptop personal computer, a laptop personal computer, a PDA, a mobile phone, a smartphone or the like.
本図では、一台の情報処理装置10として説明したが、本願発明に係るシステムは、複数の情報処理装置によって構成されてもよい。当該複数の情報処理装置は、内部的に接続されていてもよいし、外部的に接続されていてもよい。
Although described as one information processing device 10 in this figure, the system according to the present invention may be configured by a plurality of information processing devices. The plurality of information processing devices may be internally connected or may be externally connected.
また、本願発明に係るシステムは、種々の態様の装置形式であってよい。例えば、本願発明に係るシステムは、スタンドアローンであってもよいし、サーバクライアント形式であってもよいし、ピアツーピア形式であってもよいし、クラウド形式であってもよい。本願発明に係るシステムは、スタンドアローンの情報処理装置であってもよいし、サーバクライアント形式の一部又は全部の情報処理装置から構成されてもよいし、ピアツーピア形式の一部又は全部の情報処理装置から構成されてもよいし、クラウド形式の一部又は全部の情報処理装置から構成されてもよい。
Further, the system according to the present invention may be of various types of devices. For example, the system according to the present invention may be a stand-alone system, a server-client system, a peer-to-peer system, or a cloud system. The system according to the present invention may be a stand-alone information processing device, may be composed of a part or all information processing device of a server-client type, or may be a part or all information processing of a peer-to-peer type. It may be composed of devices, or may be composed of a part or all of information processing devices in cloud format.
また、本願発明に係るシステムが複数の情報処理装置で構成される場合、各情報処理装置の所有者や管理者は、異なってもよい。
Further, when the system according to the present invention is composed of a plurality of information processing devices, the owner and the manager of each information processing device may be different.
また、情報処理装置10は、物理的な存在であってもよいし、仮想的なものであってもよい。例えば、クラウドコンピューティングを用いて、情報処理装置10を仮想的に実現してもよい。
Further, the information processing device 10 may be a physical existence or a virtual one. For example, the information processing apparatus 10 may be virtually realized by using cloud computing.
上述では、本例のシステムが実施する構成として説明したが、これらは、システム内の一又は複数の情報処理装置が実施する構成であってもよい。
Although described above as the configuration implemented by the system of this example, these may be configured to be implemented by one or more information processing devices in the system.
本願書類の実施例において述べた発明例は、本願書類で説明されたものに限らず、その技術的思想の範囲内で、種々の例に適用できることはいうまでもない。例えば、本願書類における「ボタン」という用語は、物理的なボタンであってもよいし、タッチスクリーンなどの入力を受付可能な表示装置上において表示されて入力を受付可能な表示であってもよい。また、管理装置が、複数の端末装置から情報を取得する場合、各端末装置から取得するタイミングは、同時に取得してもよいし、異時に取得してもよい。また、管理装置が、複数の端末装置に情報を送信する場合、各端末装置に対して、同時に情報を送信してもよいし、異時に送信してもよい。また、一実施形態に係るプログラムは、情報について、送信及び/又は受信するための命令をそれ自体有してもよいし、他のプログラムが送信及び/又は受信が可能な状態に情報を設定するのみでもよい。
It goes without saying that the invention examples described in the examples of the documents of the present application are not limited to those described in the documents of the present application, and can be applied to various examples within the scope of the technical idea. For example, the term "button" in the document of the present application may be a physical button, or may be a display displayed on a display device that can accept input such as a touch screen and can accept input. .. Further, when the management device acquires information from a plurality of terminal devices, the timing of acquisition from each terminal device may be acquired at the same time or at different times. Further, when the management device transmits information to a plurality of terminal devices, the information may be transmitted to each terminal device at the same time or may be transmitted at different times. Further, the program according to one embodiment may itself have an instruction for transmitting and / or receiving information, and sets the information so that another program can transmit and / or receive the information. May be only.
また、本願書類で説明される処理及び手順は、実施形態において明示的に説明されたものによってのみならず、ソフトウェア、ハードウェア又はこれらの組み合わせによっても実現可能なものであってよい。また、本願書類で説明される処理及び手順は、それらの処理・手順をコンピュータプログラムとして実装し、各種のコンピュータに実行させることが可能であってよい。特に本願書類において用いられる「システム」という用語によって実現される機能の一部又は全部は、かかる情報処理装置上で実行可能なプログラムによって実現されてよい。またこれらのコンピュータプログラムは、記憶媒体に記憶されてよい。また、これらのコンピュータプログラムは、非一過性又は一時的な記憶媒体に記憶されてよい。
Further, the processes and procedures described in the documents of the present application may be feasible not only by those explicitly described in the embodiments but also by software, hardware or a combination thereof. Further, the processes and procedures described in the documents of the present application may be able to be implemented by various computers by implementing the processes and procedures as a computer program. In particular, some or all of the functions realized by the term "system" as used in the documents of the present application may be realized by a program that can be executed on such an information processing apparatus. Further, these computer programs may be stored in a storage medium. Also, these computer programs may be stored on a non-transient or temporary storage medium.
10 情報処理装置
11 演算装置
12 記憶装置
13 入力装置
14 表示装置
15 バス
16 通信装置
001、002 管理装置
001a、002a 管理者端末
011~015 利用者端末 10Information processing device 11 Arithmetic device 12 Storage device 13 Input device 14 Display device 15 Bus 16 Communication device 001, 002 Management device 001a, 002a Administrator terminal 011 to 015 User terminal
11 演算装置
12 記憶装置
13 入力装置
14 表示装置
15 バス
16 通信装置
001、002 管理装置
001a、002a 管理者端末
011~015 利用者端末 10
Claims (17)
- 第1利用者に係る第1端末装置に対し、前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、送信可能な第1送信部と、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、取得可能な取得部と、
前記利用者属性情報に基づく情報を、前記第1端末装置とは異なる第2端末装置に送信可能な第2送信部と、
を備えるシステムであって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
システム。 A program that can be executed on the WEB browser of the first terminal device to the first terminal device related to the first user can be transmitted to the first transmission unit.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. With the acquisition unit that can acquire information including
A second transmission unit capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device, and
It is a system equipped with
The user attribute information includes information indicating the presence or absence of the first user in the image.
system. - 前記プログラム内の機械学習済み機能は、画像と、利用者属性情報と、の関係を機械学習したものであって、画像に対して、対応する利用者属性情報を生成可能なものであり、
前記利用者属性情報は、前記第1端末装置に係る前記画像を含まない、ものである、
請求項1に記載のシステム。 The machine-learned function in the program is machine-learned about the relationship between the image and the user attribute information, and can generate the corresponding user attribute information for the image.
The user attribute information does not include the image related to the first terminal device.
The system according to claim 1. - 前記プログラムは、所定の入力を受け付けた後の第1所定の期間、前記プログラムが実行されている前記第1端末装置に係る前記撮像装置に対して、前記画像を取得するためのアクセスをしない、
請求項1又は2に記載のシステム。 The program does not access the image pickup device according to the first terminal device in which the program is executed for the first predetermined period after receiving the predetermined input to acquire the image.
The system according to claim 1 or 2. - 前記プログラムは、所定の入力を受け付けた後の第1所定の期間の経過後、前記プログラムが実行されている前記第1端末装置に係る前記撮像装置に対して、前記画像を取得するためのアクセスを定期的に行う、
請求項1又は2に記載のシステム。 The program is an access for acquiring the image to the image pickup device according to the first terminal device in which the program is executed after the elapse of the first predetermined period after receiving the predetermined input. Do regularly,
The system according to claim 1 or 2. - 前記利用者属性情報に基づく情報は、前記利用者属性情報に係る前記第1利用者が継続して画像内に含まれていないと判定されている時間を含む、
請求項1又は2に記載のシステム。 The information based on the user attribute information includes a time when it is determined that the first user related to the user attribute information is not continuously included in the image.
The system according to claim 1 or 2. - 前記利用者属性情報に基づく情報は、前記第1利用者の状況を示す情報を含む、
請求項1乃至4のいずれか1項に記載のシステム。 The information based on the user attribute information includes information indicating the situation of the first user.
The system according to any one of claims 1 to 4. - 前記第1利用者の状況を示す情報は、前記第1利用者が集中している状況を示す情報、前記第1利用者が会議中であることを示す情報、及び/又は、前記第1利用者がいる位置情報、を含む、
請求項4に記載のシステム。 The information indicating the situation of the first user is information indicating a situation in which the first user is concentrated, information indicating that the first user is in a meeting, and / or the first use. Including location information, where there is a person,
The system according to claim 4. - システムを、
第1利用者に係る第1端末装置に対し、前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、送信可能な第1送信手段、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、取得可能な取得手段、
前記利用者属性情報に基づく情報を、前記第1端末装置とは異なる第2端末装置に送信可能な第2送信手段、
として動作させるためのプログラムであって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
プログラム。 The system,
A first transmission means capable of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device according to the first user.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. Information that can be obtained, including
A second transmission means capable of transmitting information based on the user attribute information to a second terminal device different from the first terminal device,
It is a program to operate as
The user attribute information includes information indicating the presence or absence of the first user in the image.
program. - 前記システム内の演算装置が実行する、請求項8に記載のプログラム。 The program according to claim 8, which is executed by the arithmetic unit in the system.
- システムが、
第1利用者に係る第1端末装置に対し、前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、送信する第1送信ステップ、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、取得する取得ステップ、
前記利用者属性情報に基づく情報を、前記第1端末装置とは異なる第2端末装置に送信する第2送信ステップ、
を実行する方法であって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
方法。 the system,
A first transmission step of transmitting a program that can be executed on the WEB browser of the first terminal device to the first terminal device according to the first user.
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. Get the information, including the get step,
A second transmission step of transmitting information based on the user attribute information to a second terminal device different from the first terminal device.
Is a way to do
The user attribute information includes information indicating the presence or absence of the first user in the image.
Method. - 前記システム内の演算装置が実行する、請求項10に記載の方法。 The method according to claim 10, which is executed by the arithmetic unit in the system.
- 前記第1端末装置のWEBブラウザ上で実行可能なプログラムを、取得可能な第1取得部、
前記第1端末装置に係る撮像装置によって撮像された画像が使用されて、前記WEBブラウザ上で実行された前記プログラム内の機械学習済み機能が生成した、前記第1端末装置に係る利用者属性情報を含む情報を、送信可能な送信部、
前記第1端末装置とは異なる第2端末装置に係る利用者属性情報に基づく情報を、取得可能な取得部、
を備える第1端末装置であって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
第1端末装置。 The first acquisition unit, which can acquire a program that can be executed on the WEB browser of the first terminal device,
User attribute information related to the first terminal device generated by a machine-learned function in the program executed on the WEB browser using an image captured by the image pickup device according to the first terminal device. A transmitter that can send information, including
An acquisition unit that can acquire information based on user attribute information related to a second terminal device different from the first terminal device.
It is a first terminal device provided with
The user attribute information includes information indicating the presence or absence of the first user in the image.
First terminal device. - 前記第1端末装置内の演算装置が実行する、請求項12に記載の第1端末装置。 The first terminal device according to claim 12, which is executed by the arithmetic unit in the first terminal device.
- 第1端末装置を、
前記第1端末装置に係る撮像装置によって撮像された画像を取得する取得手段、
前記画像に対して、機械学習済み機能を適用して生成した、前記第1端末装置に係る利用者属性情報を含む情報を、管理装置に対して、送信する送信手段、
前記第1端末装置とは異なる第2端末装置に係る利用者属性情報に基づく情報を、取得する取得手段、
として動作させるための、前記第1端末装置のWEBブラウザ上で実行可能で、前記機械学習済み機能を有する、プログラムであって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
プログラム。 The first terminal device,
An acquisition means for acquiring an image captured by an image pickup device according to the first terminal device,
A transmission means for transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device.
An acquisition means for acquiring information based on user attribute information related to a second terminal device different from the first terminal device.
A program that can be executed on the WEB browser of the first terminal device and has the machine-learned function.
The user attribute information includes information indicating the presence or absence of the first user in the image.
program. - 前記第1端末装置内の演算装置が実行する、請求項14に記載のプログラム。 The program according to claim 14, which is executed by the arithmetic unit in the first terminal device.
- 機械学習済み機能を有し、WEBブラウザ上で実行可能な第1端末装置が、
前記第1端末装置に係る撮像装置によって撮像された画像を取得する取得ステップ、
前記画像に対して、機械学習済み機能を適用して生成した、前記第1端末装置に係る利用者属性情報を含む情報を、管理装置に対して、送信する送信ステップ、
前記第1端末装置とは異なる第2端末装置に係る利用者属性情報に基づく情報を、取得する取得ステップ、
を実行する方法であって、
前記利用者属性情報は、前記画像内の前記第1利用者の有無を示す情報、を含む、
方法。 The first terminal device that has machine-learned functions and can be executed on the WEB browser is
Acquisition step of acquiring an image captured by the image pickup device according to the first terminal device,
A transmission step of transmitting information including user attribute information related to the first terminal device, which is generated by applying a machine learning function to the image, to the management device.
An acquisition step of acquiring information based on user attribute information related to a second terminal device different from the first terminal device.
Is a way to do
The user attribute information includes information indicating the presence or absence of the first user in the image.
Method. - 前記第1端末装置内の演算装置が実行する、請求項16に記載の方法。 The method according to claim 16, which is executed by the arithmetic unit in the first terminal device.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020536903A JP6792224B1 (en) | 2020-07-01 | 2020-07-01 | Information processing system, information processing device, server device, program, or method |
PCT/JP2020/025875 WO2022003872A1 (en) | 2020-07-01 | 2020-07-01 | Information processing system, information processing device, server device, program, or method |
JP2020177821A JP7168999B2 (en) | 2020-07-01 | 2020-10-23 | Information processing system, information processing device, server device, program, or method |
JP2021062870A JP2022013666A (en) | 2020-07-01 | 2021-04-01 | Information processing system, information processing apparatus, server device, program, or method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2020/025875 WO2022003872A1 (en) | 2020-07-01 | 2020-07-01 | Information processing system, information processing device, server device, program, or method |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022003872A1 true WO2022003872A1 (en) | 2022-01-06 |
Family
ID=73452954
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2020/025875 WO2022003872A1 (en) | 2020-07-01 | 2020-07-01 | Information processing system, information processing device, server device, program, or method |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP6792224B1 (en) |
WO (1) | WO2022003872A1 (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2022149479A (en) * | 2021-03-25 | 2022-10-07 | 株式会社日立ソリューションズ・クリエイト | Business support system and business support method |
WO2023119992A1 (en) * | 2021-12-24 | 2023-06-29 | ソニーグループ株式会社 | Information processing device, information processing method, and program |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001069387A (en) * | 1999-08-27 | 2001-03-16 | Sony Corp | Recorder and recording method |
JP2019101566A (en) * | 2017-11-29 | 2019-06-24 | 株式会社 プロネット | Information processing system, information processing method, information processing program, and information processing apparatus |
-
2020
- 2020-07-01 WO PCT/JP2020/025875 patent/WO2022003872A1/en active Application Filing
- 2020-07-01 JP JP2020536903A patent/JP6792224B1/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001069387A (en) * | 1999-08-27 | 2001-03-16 | Sony Corp | Recorder and recording method |
JP2019101566A (en) * | 2017-11-29 | 2019-06-24 | 株式会社 プロネット | Information processing system, information processing method, information processing program, and information processing apparatus |
Also Published As
Publication number | Publication date |
---|---|
JPWO2022003872A1 (en) | 2022-01-06 |
JP6792224B1 (en) | 2020-11-25 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
RU2754990C2 (en) | Efficiency improvements in task administration applications | |
Bellotti | Design for privacy in multimedia computing and communications environments | |
US8473850B2 (en) | Methods and apparatuses for displaying and managing content during a collaboration session | |
US20130304763A1 (en) | Internal social network for an enterprise and applications thereof | |
JP4869804B2 (en) | Information sharing control system | |
CN110168537A (en) | Fast activity personnel's card of context and sociodistance's perception | |
JP2018032294A (en) | Communication support system, communication support method, computer program, and location confirmation method | |
US10567533B2 (en) | System and method to determine the presence status of a registered user on a network | |
WO2022003872A1 (en) | Information processing system, information processing device, server device, program, or method | |
CN108140149A (en) | Role's particular device behavior | |
CN105453072B (en) | The data maintenance of customer-centric | |
US11481735B1 (en) | Validating, aggregating, and managing calendar event data from external calendar resources within a group-based communication system | |
CN107196773B (en) | The method and system of interim conversation is quickly established with one or more members of group | |
Fischer | Understanding receptivity to interruptions in mobile human-computer interaction | |
Xu et al. | Learning how to feel again: Towards affective workplace presence and communication technologies | |
JP4225074B2 (en) | Dialog support apparatus and method, program, and dialog support system | |
WO2020153336A1 (en) | Information processing device, information processing method, and program | |
CN114402273A (en) | Electronic system and method for emotional state assessment | |
JP7168999B2 (en) | Information processing system, information processing device, server device, program, or method | |
Nawi et al. | Context-aware instant messenger with integrated scheduling planner | |
CN101621542A (en) | Method, system and apparatus for controlling application | |
KR20160133981A (en) | System for providing communication platform | |
JP7052094B2 (en) | Communication support system, communication support method and computer program | |
Sourdin | Mediating via Zoom | |
CHAN et al. | EXPLORING HOW CULTURE AND TASK NATURE AFFECT THE ADOPTION OF COMMUNICATION MEDIA. |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2020536903 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20943040 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20943040 Country of ref document: EP Kind code of ref document: A1 |