CN115312052A - Processing system based on digital people - Google Patents
Processing system based on digital people Download PDFInfo
- Publication number
- CN115312052A CN115312052A CN202210811002.3A CN202210811002A CN115312052A CN 115312052 A CN115312052 A CN 115312052A CN 202210811002 A CN202210811002 A CN 202210811002A CN 115312052 A CN115312052 A CN 115312052A
- Authority
- CN
- China
- Prior art keywords
- voice
- digital
- server
- module
- interaction
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 40
- 230000003993 interaction Effects 0.000 claims abstract description 57
- 238000004891 communication Methods 0.000 claims abstract description 36
- 238000003860 storage Methods 0.000 claims abstract description 15
- 230000000875 corresponding effect Effects 0.000 claims abstract description 14
- 230000009471 action Effects 0.000 claims abstract description 13
- 238000009529 body temperature measurement Methods 0.000 claims abstract description 10
- 238000001514 detection method Methods 0.000 claims abstract description 10
- 230000036760 body temperature Effects 0.000 claims description 34
- 230000006870 function Effects 0.000 claims description 14
- 238000004458 analytical method Methods 0.000 claims description 10
- 230000002452 interceptive effect Effects 0.000 claims description 10
- 238000000034 method Methods 0.000 claims description 6
- 238000003672 processing method Methods 0.000 claims description 5
- 230000002159 abnormal effect Effects 0.000 claims description 3
- 238000013459 approach Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 3
- 230000005236 sound signal Effects 0.000 claims description 3
- 238000005516 engineering process Methods 0.000 abstract description 12
- 238000004519 manufacturing process Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000006855 networking Effects 0.000 description 3
- 210000004556 brain Anatomy 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 206010063385 Intellectualisation Diseases 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 238000004080 punching Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/0022—Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
- G01J5/0025—Living bodies
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/28—Constructional details of speech recognition systems
- G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- General Physics & Mathematics (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a digital person-based processing system, which comprises a digital person terminal and a server, wherein the digital person terminal transmits data to the server, the digital person terminal is provided with an infrared detector, an image recognition unit, an interaction unit, a controller and a network communication module, and the infrared detector measures temperature and stores the temperature measurement data; the image recognition unit comprises a recognition module and a storage module; the interaction unit comprises an acquisition module and a processing module; the processing module is used for acquiring corresponding action driving information according to the action to be executed by the digital person; the controller acquires the voice prompt of the digital human terminal, the server analyzes the voice to send out a control instruction, and then further feedback is made according to a control result; the network communication module sends the collected voice signal to a server; the server provides the corresponding digital person service to the user. The processing system based on the digital human provides internal and external intelligent services for enterprises through technologies such as network communication, voice interaction, head portrait recognition and infrared detection.
Description
Technical Field
The invention relates to the technical field of human-computer interaction, in particular to a processing system based on a digital human.
Background
The digital human is a visual virtual human image with human-like intelligence, is a product of information communication technology, data technology and the like fused with industries of cultural art, 3D modeling, image design and the like, and is a method for performing virtual simulation on the shapes and functions of the human at different levels by using artificial intelligence by using an information science method. With the rapid development of computer technology, the generation technology of digital people is more and more mature.
The digital man is a system solution based on technologies such as information communication, AI voice interaction, infrared detection, head portrait recognition, big data analysis and modeling, and is an intelligent innovation platform application for introducing and publicizing the outside and performing intelligent management on the inside by enterprises. In the era of intelligent internet of things, a traditional enterprise will meet a new round of innovation and challenge in the mode of 'existing industry + new technology = new industry'. The existing digital human intelligence level is low, the human interaction effect is poor, and the production and service requirements of enterprises cannot be met.
Disclosure of Invention
The invention mainly aims to provide a processing system based on a digital person, and aims to solve the problems of low intelligent level, poor interaction effect and the like of the existing digital person.
In order to achieve the purpose, the invention provides a processing system based on a digital person, which comprises a digital person terminal used for collecting data information and a server used for providing intelligent computing service for the digital person terminal, wherein the digital person terminal is in communication connection with the server through a local area network, the digital person terminal transmits the collected data to the server and stores the data, the digital person terminal is provided with an infrared detector used for measuring temperature, an image recognition unit used for recognizing images, an interaction unit used for voice interaction, a controller used for sending instructions to received voice signals and a network communication module used for communicating and connecting the controller and the server, and the infrared detector, the image recognition unit, the interaction unit and the controller are in communication connection with one another;
the infrared detector is used for measuring the temperature of a user and storing temperature measurement data in the server;
the image recognition unit comprises a recognition module and a storage module, the recognition module is used for recognizing face data input in the system and performing rapid face recognition, welcome language interaction is broadcasted through a loudspeaker in a voice mode, and visitors are informed to arrive, and the storage module is used for storing visitor information so that the visitor information can be automatically recognized next time;
the interaction unit comprises an acquisition module and a processing module, wherein the acquisition module is used for acquiring interaction information and determining the action to be executed by the digital person according to the interaction information; the processing module is used for acquiring corresponding action driving information according to the action to be executed by the digital person;
the controller acquires a voice prompt of the digital human terminal, the server analyzes the voice to send out a control instruction, and further feedback is made according to a control result;
the network communication module sends the collected voice signal to a server;
the server provides the corresponding digital human service to the user.
Preferably, when the infrared detector detects the body temperature, if the body temperature of the user is normal, the infrared detector allows the passing and the next operation is carried out; if the body temperature of the user exceeds the set range, an alarm indicator lamp in the digital human terminal is lightened, an alarm sound is given out for warning, and the user is not allowed to pass through.
Preferably, the digital human terminal is provided with a loudspeaker, and after the temperature measurement of each user is finished, the loudspeaker can be used for voice broadcasting of the body temperature and generating a body temperature analysis result report to be stored in the server.
Preferably, the recognition module comprises a face recognition module for recognizing a face image and a voice recognition module for recognizing voice; the recognition module provides an AI recognition function, and when recognizing the face image, the face image of the user is firstly acquired, the visiting client is recognized, and the face image is stored in the server through the storage module and can be automatically recognized next time.
Preferably, the acquisition module acquires voice data of a user, performs voice processing and analysis through the processing module, makes corresponding feedback according to an analysis result, and transmits the data to the server.
Preferably, the controller is in communication connection with the intelligent device through the network communication module, and controls the intelligent device to search for information data or make voice broadcast according to voice prompt.
Preferably, the server provides intelligent voice interactive computation for the digital human terminal, controls the internal networking equipment of the enterprise, and responds to the intelligent service function required by the digital human terminal.
Preferably, the digital human terminal is a computer display or a mobile phone or an intelligent screen device.
The invention also provides a processing method based on the digital human, which comprises the following steps,
s1: when a user approaches the digital human terminal, the infrared detector starts to measure the body temperature, the body temperature can enter the digital human terminal if the body temperature is normal, and the body temperature cannot enter the digital human terminal if the body temperature is abnormal;
s2: after the body temperature is measured, the face recognition module recognizes face data of a user and carries out rapid face recognition, welcome language interaction is broadcasted through a loudspeaker in a voice mode, visitors are informed to arrive, and the voice recognition module recognizes voice signals of the user and sends the voice signals to the interaction unit;
s3: when the face image data of the user is identified, the storage module stores visitor information;
s4: the interactive information is obtained through the obtaining module, the action to be executed of the digital person is determined according to the interactive information through the processing module, corresponding action driving information is obtained, and the executed action is transmitted to the controller;
s5: and finally, the voice prompt acquired by the controller is used, the acquired voice signal is sent to the server through the network communication module, the server analyzes the voice to send out a control instruction, and further feedback is made according to a control result, so that the interaction between the user and the digital person is realized.
Preferably, when voice recognition is performed, if the recognized sound is a preset keyword or keyword audio signal, interaction is performed; when the human face is identified, if the identified human face is a living human face detection signal, interaction is carried out.
The technical scheme of the invention has the beneficial effects that:
the digital human processing system mainly comprises a digital human terminal and a server, wherein the digital human terminal is provided with an infrared detector, an image recognition unit, an interaction unit, a controller and a network communication module, and the infrared detector is used for measuring temperature; the image recognition unit is used for recognizing images and voices; the interaction unit is used for interacting with the user voice; the controller is used for sending out an instruction to the received voice signal; the network communication module is used for connecting the controller and the server in a communication way; the method comprises the steps that internal and external intelligent services are provided for enterprises through technologies such as network communication, voice interaction, head portrait recognition and infrared detection, and data information generated by a business system is collected and managed for the enterprises; the new information technologies such as AI, big data and the like are used for constructing the brains of enterprises for the enterprises, assisting intelligent decision making and business automation, further reducing the cost and improving the efficiency of the enterprises in providing refined production and service.
Drawings
FIG. 1 is a block diagram of a digital human-based processing system according to an embodiment of the present invention.
FIG. 2 is a schematic diagram of a digital human-based processing system according to an embodiment of the present invention.
FIG. 3 is a flowchart of an embodiment of a digital human-based processing method according to the present invention.
Detailed Description
In the following, the embodiments of the present invention will be described in detail and completely, and obviously, the described embodiments are only a part of the embodiments of the present invention, but not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The invention provides a digital human-based processing system as a preferred embodiment of the invention, referring to fig. 1-2, the invention provides a digital human-based processing system, which comprises a digital human terminal 1 for collecting data information and a server 2 for providing intelligent computing service for the digital human terminal, wherein the digital human terminal 1 and the server 2 are in communication connection through a local area network, the digital human terminal 1 transmits the collected data to the server 2 and stores the collected data, the digital human terminal 1 is provided with an infrared detector 11 for measuring temperature, an image recognition unit 12 for image recognition, an interaction unit 13 for voice interaction, a controller 14 for sending an instruction to a received voice signal and a network communication module 15 for communication connection of the controller and the server, and the infrared detector 11, the image recognition unit 12, the interaction unit 13 and the controller 14 are in communication connection with each other. The digital human terminal 1 is a computer display or a mobile phone or a smart screen device, and specifically, the digital human terminal 1 is an electronic device similar to a smart phone or a computer, running Android/IOS, windows, mac OS, and having functions of network communication, voice input/output, camera recognition, infrared detection and display, and the like.
The infrared detector 11 is used for measuring the temperature of the user and storing temperature measurement data in the server;
the image recognition unit 12 comprises a recognition module 121 and a storage module 122, wherein the recognition module 121 is used for recognizing face data recorded in the system and performing rapid face recognition, and broadcasting welcome language interaction and informing visitors of arriving through speaker voice, and the storage module 122 is used for storing visitor information so as to be automatically recognized next time;
the interaction unit 13 includes an obtaining module 131 and a processing module 132, where the obtaining module 131 is configured to obtain interaction information, and determine an action to be performed by the digital person according to the interaction information; the processing module 132 is configured to obtain corresponding action driving information according to an action to be performed by the digital person;
the controller 14 acquires the voice prompt of the digital human terminal, the server analyzes the voice to send out a control instruction, and further feedback is made according to a control result;
the network communication module 15 sends the collected voice signal to the server;
the server 2 provides a corresponding digital person service to the user.
The processing system based on the digital human of the invention provides the internal and external intelligent services for enterprises through the technologies of network communication, voice interaction, image recognition, infrared detection and the like, and collects and manages the data information generated by the business system for the enterprises; the new information technologies such as AI, big data and the like are used for constructing the brains of enterprises for the enterprises, assisting intelligent decision making and business automation, further reducing the cost and improving the efficiency of the enterprises in providing refined production and service. The digital human terminal 1 and the server 2 communicate through a local area network, the digital human terminal 1 has the functions of infrared detection, image recognition, intelligent voice interaction and the like, wherein the infrared detector 11 can be used for temperature measurement, and the image recognition unit 12 can be used for employee attendance card punching, for example; the interaction unit 3 can be used for introducing enterprise products and services to the outside, which is equivalent to intelligent foreground or administrative, and reduces the pressure of personnel; the server 2 is used to collect data and store it for the next automatic identification, for example: temperature measurement data or image recognition data are stored in the data server 2, and the server provides intelligent calculation functions such as intelligent voice interaction and the like for the digital human terminal 1; the server 2 is constructed based on the integration of new information technologies such as AI, big data and the like, thereby realizing the intellectualization and automation of the enterprise, driving the intellectualized upgrade of a business system, and improving the efficiency of individualized, customized and refined production and service reduction of the enterprise.
The image recognition unit 12 of the processing system comprises a recognition module 121 and a storage module 122, and when the processing system is used, an AI recognition function is provided by acquiring face images of employees or clients, and the recognition result is further processed by voice interaction or business; the image recognition unit is set as a recognition module and a storage module, rapid face recognition can be carried out according to face data recorded by the system, functions of visitor detection, welcome language interaction, client arrival notification and the like can be provided, visitors can be remembered, automatic recognition can be carried out next time, and functions of attendance tracking, supervision reminding and the like can be provided.
The interactive unit 13 of the processing system comprises an acquisition module 131 and a processing module 132, the interactive unit 13 can interact with a human body to introduce enterprise products and services in a question-and-answer mode, can provide option modes to introduce enterprises in a voice-combined mode, and can assist in introducing enterprises in a pop-up picture or video mode.
The digital human terminal 1 also comprises a controller 14, the controller 14 can obtain the voice prompt, the digital server analyzes the voice to send out a control instruction, and further feedback is made according to the control result. The controller can control the intelligent equipment or search and search information data or make voice broadcast according to the voice prompt.
The controller 14 can control the internal devices of the enterprise according to the voice prompt, for example, turn on an air conditioner or a projector in advance, can help the enterprise leader to quickly find the internal data and files of the enterprise, can help the enterprise leader to pay attention to a certain current affair hotspot and briefly report the current affair hotspot, and can help the enterprise leader to make a basic decision on the internal affairs of the enterprise, wherein the processing flow is as follows: firstly, voice prompt is obtained, the server analyzes and understands voice and sends out a control instruction, and further feedback is made according to a control result.
The network communication module 15 is in communication connection with the server 2, and the network communication module sends the collected voice signal to the server 2. The server 2 can provide intelligent voice interactive calculation for the digital human terminal 1, can control the internal networking equipment of the enterprise, and can respond to the intelligent service function required by the digital human terminal. The server 2 is a start-stop server, and can configure parameters such as a server IP (Internet protocol), a port and the like, and the interaction process of the server is as follows: firstly, voice data are obtained, then natural language processing and analysis are carried out, and finally feedback is carried out according to an analysis result.
In a preferred embodiment, when the infrared detector detects the body temperature, if the body temperature of the user is normal, the infrared detector allows the user to pass through, and the next operation is performed; if the body temperature of the user exceeds the set range, an alarm indicator lamp in the digital human terminal is lightened, an alarm sound is given out for warning, and the user is not allowed to pass through. The human body temperature measurement is acquired by arranging the infrared detector, and the body temperature analysis result are broadcasted through voice, so that the system can be used for recording staff health data for enterprises. The normal temperature of the human body is 36.3-37.2 ℃, and the human body is judged to be normal in the interval and allowed to pass.
In a preferred embodiment, referring to fig. 2, the digital human terminal 1 of the processing system is provided with a speaker 10, and after the temperature measurement of each user is finished, the speaker broadcasts the body temperature by voice and generates a body temperature analysis result report to be stored in the server 2.
The recognition module 121 includes a face recognition module for recognizing a face image and a voice recognition module for recognizing a voice; the recognition module provides an AI recognition function, and when recognizing the face image, the face image of the user is acquired first, the visiting client is recognized, and the face image is stored in the server through the storage module 122, and the face image can be automatically recognized next time. The obtaining module 131 obtains the voice data of the user, processes and analyzes the voice data through the processing module 132, and then makes corresponding feedback according to the analysis result, and transmits the data into the server 2. The controller 14 is in communication connection with the intelligent device through the network communication module 15, and controls the intelligent device to search for information data or make voice broadcast according to voice prompt. The server 2 provides intelligent voice interactive calculation for the digital human terminal 1, controls the internal networking equipment of the enterprise, and responds to the intelligent service function required by the digital human terminal 1.
The invention also provides a processing method based on digital people, which comprises the following steps,
s1: when a user approaches the digital human terminal 1, the infrared detector 11 starts to measure the body temperature, the body temperature can enter the digital human terminal if the body temperature is normal, and the body temperature cannot enter the digital human terminal if the body temperature is abnormal;
s2: after the body temperature is measured, the face recognition module recognizes face data of a user and performs rapid face recognition, welcome language interaction is broadcasted through a loudspeaker in a voice mode, visitors are informed to arrive, and the voice recognition module recognizes voice signals of the user and transmits the voice signals to the interaction unit;
s3: when recognizing the face image data of the user, the storage module 122 stores visitor information;
s4: acquiring interaction information through an acquisition module 131, determining an action to be executed by the digital person according to the interaction information through a processing module 132, acquiring corresponding action driving information, and transmitting the execution action to a controller;
s5: finally, the voice prompt acquired by the controller 14 and the acquired voice signal are sent to the server 2 through the network communication module 15, the server 2 analyzes the voice to send out a control instruction, and further feedback is made according to a control result, so that interaction between the user and the digital person is realized.
According to the step S2, when voice recognition is carried out, if the recognized sound is a preset keyword or keyword audio signal, voice interaction is carried out, the server sends out an instruction to feed back, and if the recognized sound is not in the preset keyword or keyword range, interaction with a user is not carried out; when the human face is identified, if the identified human face is a living human face detection signal, voice interaction is carried out, the server sends an instruction to feed back, and if the identified human face is a picture or a human face pattern in other forms, interaction with a user is not carried out.
The above description is only a part of or preferred embodiments of the present invention, and neither the text nor the drawings should be construed as limiting the scope of the present invention, and all equivalent structural changes, which are made by using the contents of the present specification and the drawings, or any other related technical fields, are included in the scope of the present invention.
Claims (10)
1. A processing system based on a digital person is characterized by comprising a digital person terminal for collecting data information and a server for providing intelligent computing service for the digital person terminal, wherein the digital person terminal is in communication connection with the server through a local area network, the digital person terminal transmits collected data to the server and stores the collected data, an infrared detector for measuring temperature, an image recognition unit for recognizing images, an interaction unit for voice interaction, a controller for sending instructions to received voice signals and a network communication module for communicating and connecting the controller and the server are arranged on the digital person terminal, and the infrared detector, the image recognition unit, the interaction unit and the controller are in communication connection with one another;
the infrared detector is used for measuring the temperature of a user and storing temperature measurement data in the server;
the image recognition unit comprises a recognition module and a storage module, the recognition module is used for recognizing face data input in the system and performing rapid face recognition, welcome language interaction is broadcasted through a loudspeaker in a voice mode, and visitors are informed to arrive, and the storage module is used for storing visitor information so that the visitor information can be automatically recognized next time;
the interaction unit comprises an acquisition module and a processing module, wherein the acquisition module is used for acquiring interaction information and determining the action to be executed by the digital person according to the interaction information; the processing module is used for acquiring corresponding action driving information according to the action to be executed by the digital person;
the controller acquires a voice prompt of the digital human terminal, the server analyzes the voice to send out a control instruction, and further feedback is made according to a control result;
the network communication module sends the collected voice signal to a server;
the server provides the corresponding digital human service to the user.
2. The digital human-based processing system according to claim 1, wherein when the infrared detector detects the body temperature, if the body temperature of the user is normal, the infrared detector allows the passing and the following operation; if the body temperature of the user exceeds the set range, an alarm indicator lamp in the digital human terminal is lightened, an alarm sound is given out for warning, and the user is not allowed to pass through.
3. The digital human-based processing system according to claim 1, wherein a speaker is provided on the digital human terminal, and after the temperature measurement of each user is completed, the speaker can perform voice body temperature broadcast and generate a body temperature analysis result report to be stored in the server.
4. The digital human-based processing system of claim 1, wherein the recognition module comprises a face recognition module for recognizing a face image and a voice recognition module for recognizing voice; the recognition module provides an AI recognition function, and when recognizing the face image, the face image of the user is firstly acquired, the visiting client is recognized, and the face image is stored in the server through the storage module and can be automatically recognized next time.
5. The system of claim 1, wherein the acquisition module acquires voice data of a user, processes and analyzes the voice data through the processing module, and makes corresponding feedback according to the analysis result, and transmits the data to the server.
6. The digital human-based processing system according to claim 1, wherein the controller is in communication connection with the intelligent device through the network communication module, and controls the intelligent device to search for information materials or make voice broadcast according to voice prompt.
7. The system according to claim 1, wherein the server provides intelligent voice interactive computation to the digital human terminal, controls intranet devices, and responds to intelligent service functions required by the digital human terminal.
8. The digital human-based processing system of claim 1, wherein the digital human terminal is a computer monitor or a mobile phone or a smart screen device.
9. A processing method based on digital people is characterized in that: comprises the following steps of (a) carrying out,
s1: when a user approaches the digital human terminal, the infrared detector starts to measure the body temperature, the body temperature can enter the digital human terminal if the body temperature is normal, and the body temperature cannot enter the digital human terminal if the body temperature is abnormal;
s2: after the body temperature is measured, the face recognition module recognizes face data of a user and performs rapid face recognition, welcome language interaction is broadcasted through a loudspeaker in a voice mode, visitors are informed to arrive, and the voice recognition module recognizes voice signals of the user and transmits the voice signals to the interaction unit;
s3: when the face image data of the user is identified, the storage module stores visitor information;
s4: the interactive information is obtained through the obtaining module, the action to be executed of the digital person is determined according to the interactive information through the processing module, corresponding action driving information is obtained, and the executed action is transmitted to the controller;
s5: and finally, the voice prompt acquired by the controller is used, the acquired voice signal is sent to the server through the network communication module, the server analyzes the voice to send out a control instruction, and further feedback is made according to a control result, so that the interaction between the user and the digital person is realized.
10. The digital human-based processing method of claim 9, wherein: during voice recognition, if the recognized sound is a preset keyword or a keyword audio signal, interaction is performed; when the human face is identified, if the identified human face is a living human face detection signal, interaction is carried out.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210811002.3A CN115312052A (en) | 2022-07-11 | 2022-07-11 | Processing system based on digital people |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210811002.3A CN115312052A (en) | 2022-07-11 | 2022-07-11 | Processing system based on digital people |
Publications (1)
Publication Number | Publication Date |
---|---|
CN115312052A true CN115312052A (en) | 2022-11-08 |
Family
ID=83857003
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202210811002.3A Pending CN115312052A (en) | 2022-07-11 | 2022-07-11 | Processing system based on digital people |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN115312052A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116883608A (en) * | 2023-09-05 | 2023-10-13 | 武汉纺织大学 | Multi-mode digital person social attribute control method and related device |
CN117198293A (en) * | 2023-11-08 | 2023-12-08 | 北京烽火万家科技有限公司 | Digital human voice interaction method, device, computer equipment and storage medium |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105721259A (en) * | 2016-01-29 | 2016-06-29 | 江西智能无限物联科技有限公司 | Intelligent interaction robot |
CN112233263A (en) * | 2020-08-25 | 2021-01-15 | 云南乐进科技有限公司 | Attendance management system based on face image recognition |
CN112509194A (en) * | 2020-12-16 | 2021-03-16 | 山东依鲁光电科技有限公司 | Unattended intelligent entrance guard system |
CN114360105A (en) * | 2021-12-15 | 2022-04-15 | 中用科技有限公司 | Wisdom visitor management and control platform |
-
2022
- 2022-07-11 CN CN202210811002.3A patent/CN115312052A/en active Pending
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105721259A (en) * | 2016-01-29 | 2016-06-29 | 江西智能无限物联科技有限公司 | Intelligent interaction robot |
CN112233263A (en) * | 2020-08-25 | 2021-01-15 | 云南乐进科技有限公司 | Attendance management system based on face image recognition |
CN112509194A (en) * | 2020-12-16 | 2021-03-16 | 山东依鲁光电科技有限公司 | Unattended intelligent entrance guard system |
CN114360105A (en) * | 2021-12-15 | 2022-04-15 | 中用科技有限公司 | Wisdom visitor management and control platform |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN116883608A (en) * | 2023-09-05 | 2023-10-13 | 武汉纺织大学 | Multi-mode digital person social attribute control method and related device |
CN116883608B (en) * | 2023-09-05 | 2023-12-12 | 武汉纺织大学 | Multi-mode digital person social attribute control method and related device |
CN117198293A (en) * | 2023-11-08 | 2023-12-08 | 北京烽火万家科技有限公司 | Digital human voice interaction method, device, computer equipment and storage medium |
CN117198293B (en) * | 2023-11-08 | 2024-01-26 | 北京烽火万家科技有限公司 | Digital human voice interaction method, device, computer equipment and storage medium |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN115312052A (en) | Processing system based on digital people | |
US20210365343A1 (en) | Artificial Intelligence (AI)-Based Cloud Computing Safety Monitoring System | |
CN111612933A (en) | Augmented reality intelligent inspection system based on edge cloud server | |
CN108574515B (en) | Data sharing method, device and system based on intelligent sound box equipment | |
CN109377995B (en) | Method and device for controlling equipment | |
CN109447232A (en) | Robot active inquiry method, apparatus, electronic equipment and storage medium | |
CN110225141B (en) | Content pushing method and device and electronic equipment | |
US11257355B2 (en) | System and method for preventing false alarms due to display images | |
CN111652058A (en) | Computer face recognition device | |
CN109522996A (en) | Constant mark object automatic identification control system | |
CN110852306A (en) | Safety monitoring system based on artificial intelligence | |
CN111970471B (en) | Conference participant scoring method, device, equipment and medium based on video conference | |
CN108334764A (en) | A kind of robot cloud operating system that personnel are carried out with Multiple recognition | |
CN107610260B (en) | Intelligent attendance system and attendance method based on machine vision | |
CN106997449A (en) | Robot and face identification method with face identification functions | |
CN111985252A (en) | Dialogue translation method and device, storage medium and electronic equipment | |
CN115269608A (en) | Digital platform based on iframe embedded 3D digital twin structure | |
CN115544234A (en) | User interaction method and device, electronic equipment and storage medium | |
CN115118536B (en) | Sharing method, control device and computer readable storage medium | |
CN210534865U (en) | Sign-in system | |
CN114187650A (en) | Action recognition method and device, electronic equipment and storage medium | |
CN111800437A (en) | Artificial intelligence's safety network system | |
CN212381315U (en) | Intelligent video tracking monitoring system | |
CN205334503U (en) | Robot with face identification function | |
CN116260844B (en) | Community cloud edge end architecture system based on Internet of things mode, community data processing method and control system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |