CN111787284A - Data acquisition system - Google Patents
Data acquisition system Download PDFInfo
- Publication number
- CN111787284A CN111787284A CN202010686323.6A CN202010686323A CN111787284A CN 111787284 A CN111787284 A CN 111787284A CN 202010686323 A CN202010686323 A CN 202010686323A CN 111787284 A CN111787284 A CN 111787284A
- Authority
- CN
- China
- Prior art keywords
- data
- acquisition system
- data acquisition
- server
- management
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003860 storage Methods 0.000 claims abstract description 44
- 238000009826 distribution Methods 0.000 claims description 11
- 238000007726 management method Methods 0.000 abstract description 52
- 238000013500 data storage Methods 0.000 abstract description 7
- 238000000034 method Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 238000012423 maintenance Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23103—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion using load balancing strategies, e.g. by placing or distributing content on different disks, different memories or different servers
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a data acquisition system, in the data acquisition system, each terminal device only needs to send the self sensing data to a management server, namely, only a terminal device manufacturer is required to set the default data receiving address of each terminal device as the IP address of the management server in a unified way when providing the terminal device, and a worker does not need to set the data receiving address of the purchased terminal device by himself, so that the workload is reduced, the labor cost is saved, a plurality of interface servers can simultaneously carry out the storage control of the sensing data, and the data storage efficiency can be improved.
Description
Technical Field
The invention relates to the field of communication, in particular to a data acquisition system.
Background
Data can be generated in each link in human daily production and life, a lot of data need be collected through terminal equipment, for example, the intelligent transportation field can adopt the camera to carry out the collection of image, and electric power field often adopts electric energy sensor to carry out the collection of electric energy parameter, and need set up a large amount of terminal equipment when carrying out data acquisition in the practical application process and carry out data acquisition usually, the engineering is huge, consequently, how to spend less human cost and establish high-efficient stable data acquisition system, in order to realize the collection and the storage to appointed data, be present research focus.
Therefore, how to provide a solution to the above technical problem is a problem that needs to be solved by those skilled in the art.
Disclosure of Invention
The invention aims to provide a data acquisition system, which does not need to set a data receiving address of purchased terminal equipment by a worker, reduces the workload, saves the labor cost, can simultaneously perform storage control on sensing data by a plurality of interface servers, and can improve the data storage efficiency.
In order to solve the above technical problem, the present invention provides a data acquisition system, including:
the terminal equipment is used for sending the acquired sensing data to the management server;
the management server is used for respectively sending the sensing data to the plurality of interface servers according to a preset distribution principle;
the interface servers are used for storing the sensing data received by the interface servers to a storage system;
the storage system.
Preferably, the preset allocation principle is an allocation principle of data volume balance allocation.
Preferably, the storing the sensing data received by the storage system specifically includes:
storing the sensing data received by the sensing data self to a preset storage directory corresponding to a storage system according to the corresponding relation between the preset identification data and the storage directory;
the sensing data includes the identification data of the corresponding terminal device.
Preferably, the identification data includes a preset point location area where the terminal device is located and an IP address of the terminal device.
Preferably, the plurality of terminal devices are terminal devices of the same type.
Preferably, the terminal devices are all cameras.
Preferably, the storage system is a distributed storage system.
Preferably, the management server includes:
the management main server is used for respectively sending the sensing data to the plurality of interface servers according to a preset distribution principle;
and the management standby server is used for exchanging roles with the management main server when the management main server fails.
Preferably, the data acquisition system further comprises:
an alarm;
the management standby server is further configured to control the alarm to alarm when the management main server fails.
Preferably, the alarm is a buzzer.
The invention provides a data acquisition system, in the data acquisition system, each terminal device only needs to send the self sensing data to a management server, namely, only a terminal device manufacturer is required to set the default data receiving address of each terminal device as the IP address of the management server in a unified way when providing the terminal device, and a worker does not need to set the data receiving address of the purchased terminal device by himself, so that the workload is reduced, the labor cost is saved, a plurality of interface servers can simultaneously carry out the storage control of the sensing data, and the data storage efficiency can be improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed in the prior art and the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.
FIG. 1 is a schematic structural diagram of a data acquisition system according to the present invention;
fig. 2 is a schematic diagram illustrating another data acquisition system according to the present invention.
Detailed Description
The core of the invention is to provide a data acquisition system, which does not need to set the data receiving address of the purchased terminal equipment by the staff, reduces the workload, saves the labor cost, can simultaneously carry out the storage control of the sensing data by a plurality of interface servers, and can improve the data storage efficiency.
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, fig. 1 is a schematic structural diagram of a data acquisition system provided in the present invention, the data acquisition system including:
the plurality of terminal devices 1 are used for sending the acquired sensing data to the management server 2;
the management server 2 is used for respectively sending the sensing data to the plurality of interface servers 3 according to a preset distribution principle;
the interface servers 3 are used for storing the sensing data received by the interface servers to the storage system 4;
a storage system 4.
Specifically, in view of the technical problems in the background art as described above, and in view of the fact that if a plurality of interface servers 3 are directly used to receive a large amount of data of the terminal devices 1, although the efficiency of data storage can be improved by simultaneously performing storage control on the plurality of interface servers 3, due to the fact that the IP addresses of the plurality of interface servers 3 are different, the IP addresses of the target devices to which a large amount of terminal devices 1 need to transmit their own sensing data are not uniform, and the IP addresses of a large amount of terminal devices 1 must be configured one by a worker, which results in a huge workload, high possibility of error, and high labor cost, in the embodiment of the present invention, one management server 2 is provided between the plurality of interface servers 3 and the plurality of terminal devices 1, and the management server 2 can first receive the sensing data of all the terminal devices 1 in a centralized manner, therefore, at least the unification of the IP addresses of the data sending targets of the terminal devices 1 is ensured, and before the terminal devices 1 leave a factory, a manufacturer usually configures a default target device IP address for the terminal devices 1 in advance, so that when the terminal devices 1 are purchased, the manufacturer only needs to be informed of the IP address of the management server 2, and uses the IP address of the management server 2 as the default IP address of each terminal device 1, or after the terminal devices 1 are purchased, a worker directly configures the IP address of the management server 2 as the default IP address of each terminal device 1, and all the terminal devices 1 can smoothly send the self-sensing data to the management server 2, and the workload of a data acquisition system builder is reduced on the basis of not increasing the workload of the manufacturer of the terminal devices 1, thereby reducing the labor cost.
Specifically, considering that in a data acquisition system, the data volume of the terminal device 1 is usually very large, for example, hundreds of cameras may be used, and if the storage control is performed on the sensing data of all the terminal devices 1 through only one interface server 3, the sensing data is likely to be blocked and lost, the storage speed is slow, and the storage efficiency is poor, so that the embodiment of the present invention simultaneously sets a plurality of interface servers 3 to perform storage control on the sensing data, improves the data storage speed, and ensures that the data is not blocked and lost.
The number of the terminal devices 1 may be set autonomously according to the actual situation of the project, for example, the number may be 300, and the embodiment of the present invention is not limited herein.
Specifically, the number of the interface servers 3 may be autonomously set according to the number of the terminal devices 1, and in general, one interface server 3 may perform storage control on sensing data of a large number of terminal devices 1, so that the number of the interface servers 3 is usually much smaller than the number of the terminal devices 1, for example, the number of the interface servers may be 5, and the embodiment of the present invention is not limited herein.
The invention provides a data acquisition system, in the data acquisition system, each terminal device only needs to send the self sensing data to a management server, namely, only a terminal device manufacturer is required to set the default data receiving address of each terminal device as the IP address of the management server in a unified way when providing the terminal device, and a worker does not need to set the data receiving address of the purchased terminal device by himself, so that the workload is reduced, the labor cost is saved, a plurality of interface servers can simultaneously carry out the storage control of the sensing data, and the data storage efficiency can be improved.
For better explaining the embodiment of the present invention, please refer to fig. 2, fig. 2 is a schematic structural diagram of another data acquisition system provided by the present invention, and on the basis of the above embodiment:
as a preferred embodiment, the preset allocation principle is an allocation principle of data amount balance allocation.
Specifically, it is considered that, if the amount of data distributed to the plurality of interface servers 3 is not uniform, for example, if a certain interface server 3 is distributed with too much amount of data, while the other interface server 3 is allocated too little data volume, for an interface server 3 with too much data volume, which may cause problems of data congestion and too much working pressure, on the one hand, data loss and, on the other hand, a shortened service life, while for interface servers 3 with too little data, it may exist in an idle state for a long time, resulting in a low efficiency of use, creating a waste of resources, therefore, in the embodiment of the present invention, the distribution principle of data amount balanced distribution is adopted to distribute all the sensing data to each interface server 3, so as to prolong the service life of each interface server 3, and the probability of data loss is reduced, and the operation resources of the interface server 3 are reasonably utilized.
Of course, besides the distribution principle of the data amount balance distribution, the distribution principle may be of other various types, and the embodiment of the present invention is not limited herein.
As a preferred embodiment, storing the sensing data received by itself to the storage system 4 specifically includes:
storing the sensing data received by the sensing data self to a preset storage directory corresponding to the storage system 4 according to the corresponding relation between the preset identification data and the storage directory;
the sensing data includes the identification data of the corresponding terminal device 1.
Specifically, in order to regularly store the sensing data and facilitate the user to obtain the designated data, in the embodiment of the present invention, a storage directory corresponding to the identification data is provided, and the user can distinguish the sensing data in different storage directories according to the difference of the storage directories, so as to achieve the obtaining of the designated sensing data, for example, when the terminal device 1A sends the self sensing data, the IP address of the user and the preset bit region where the user is located, for example, the first bit region and 192.168.1.20, may be added to the sensing data, and then the data may be stored in the folder named by the IP address 192.168.1.20 in the first bit region directory.
Specifically, when analyzing the identification data, the interface server 3 may analyze the identification data by a VCS (version control system) or the like, which is not limited herein.
The identification data may be of various types, for example, may be a preset point location area where the terminal device 1 is located, and the embodiment of the present invention is not limited herein.
It should be noted that even if a certain interface server 3 fails, the management server 2 can allocate the sensing data indiscriminately, that is, the failure of the interface server 3 does not affect the normal operation of the whole system.
As a preferred embodiment, the identification data includes a preset site area where the terminal device 1 is located and an IP address of the terminal device 1.
The combination of the identification data can be applied to various fields, such as the field of image acquisition of intelligent transportation, and the storage directory of the sensing data corresponding to each terminal device 1 can be accurately divided through the combination of the identification data, so that a user can conveniently find the designated data.
Of course, besides the combination of the identification data, the identification data may be of other types, and the embodiment of the present invention is not limited herein.
As a preferred embodiment, the plurality of terminal apparatuses 1 are the same type of terminal apparatus 1.
Specifically, in a data acquisition system, a plurality of terminal devices 1 may be of a uniform type, so that a server in the system can process only the sensing data, thereby improving data processing efficiency and prolonging the service life of the server.
Of course, the terminal device 1 in the data acquisition system may also include multiple types, such as an image acquisition device and an audio acquisition device, and the embodiment of the present invention is not limited herein.
As a preferred embodiment, the terminal devices 1 are each a video camera.
Specifically, the camera can be applied to an image acquisition system for acquiring pictures or videos, can meet the current image data acquisition requirements of people, and has the advantage of long service life.
Of course, the terminal device 1 may be of various types other than the camera, and the embodiment of the present invention is not limited herein.
As a preferred embodiment, the storage system 4 is a distributed storage system 4.
Specifically, the distributed storage system 4 has the advantages of supporting hierarchical storage, high fault tolerance rate, and the like.
Of course, the storage system 4 may be of various types other than the distributed storage system 4, and the embodiment of the present invention is not limited herein.
As a preferred embodiment, the management server 2 includes:
the management main server 21 is configured to send the sensing data to the plurality of interface servers 3 according to a preset allocation principle;
and a management backup server 22 for performing role switching with the management main server 21 when the management main server 21 fails.
Specifically, in consideration of the important role of the management server 2 in the data acquisition system (uniformly managing the distribution of all the sensing data), as long as the management server 2 fails, the entire system will be broken down, and in order to prevent this, in the embodiment of the present invention, a redundant management server 2 is provided, that is, a management primary server 21 and a management backup server 22 are provided, which can monitor the failure of each other, and can deprive the right when the other party is the management primary server 21 and monitors the failure of the other party, so that the other party becomes the management primary server 21, naturally becomes the management backup server 22, and the other party needs the staff to perform inspection and maintenance.
The management standby server 22 may monitor a fault of the management primary server 21 under the condition that the management primary server 21 normally operates, and the specific monitoring method may be multiple, which is not limited herein in the embodiment of the present invention.
Specifically, after the management standby server 22 takes the right and becomes the management main server 21, it may take over the original data processing task of the management main server 21 for processing, and in order to ensure that the processing task is perfectly connected, the management standby server 22 may copy the contents of the process, the data, and the like in the management main server 21, which is not limited in this embodiment of the present invention.
As a preferred embodiment, the data acquisition system further comprises:
an alarm 5;
the management standby server 22 is also used to control the alarm 5 to alarm when the management primary server 21 fails.
Specifically, in consideration of the fact that when the primary management server 21 fails, the backup management server 22 may work instead of the primary management server, but if the failed server is not maintained for a long time, once the working server fails, the whole data acquisition system may stop working, resulting in a large amount of data loss, in order to prevent this situation, the alarm 5 is provided in the embodiment of the present invention, and the backup management server 22 may control the alarm 5 to alarm at the first time when the primary management server 21 fails, so that a worker can quickly obtain information about the server failure and perform maintenance, and the occurrence of a data acquisition system failure can be avoided.
As a preferred embodiment, the alarm 5 is a buzzer.
Specifically, the buzzer has the advantages of small volume, simple structure, low cost and the like.
Of course, besides the buzzer, the alarm 5 may be of various types, such as a light emitting diode, LED, and the like, and the embodiment of the present invention is not limited herein.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. It should also be noted that, in the present specification, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A data acquisition system, comprising:
the terminal equipment is used for sending the acquired sensing data to the management server;
the management server is used for respectively sending the sensing data to the plurality of interface servers according to a preset distribution principle;
the interface servers are used for storing the sensing data received by the interface servers to a storage system;
the storage system.
2. The data acquisition system according to claim 1, wherein the preset allocation principle is an allocation principle of data volume balance allocation.
3. The data acquisition system according to claim 2, wherein the storing of the sensing data received by the data acquisition system into a storage system is specifically:
storing the sensing data received by the sensing data self to a preset storage directory corresponding to a storage system according to the corresponding relation between the preset identification data and the storage directory;
the sensing data includes the identification data of the corresponding terminal device.
4. The data acquisition system according to claim 3, wherein the identification data includes a preset site area where the terminal device is located and an IP address of the terminal device.
5. The data acquisition system according to claim 1, wherein the plurality of terminal devices are terminal devices of the same type.
6. The data acquisition system according to claim 5, wherein the terminal devices are all cameras.
7. The data acquisition system of claim 1, wherein the storage system is a distributed storage system.
8. The data acquisition system according to any one of claims 1 to 7, wherein the management server comprises:
the management main server is used for respectively sending the sensing data to the plurality of interface servers according to a preset distribution principle;
and the management standby server is used for exchanging roles with the management main server when the management main server fails.
9. The data acquisition system of claim 8, further comprising:
an alarm;
the management standby server is further configured to control the alarm to alarm when the management main server fails.
10. The data acquisition system of claim 9, wherein the alarm is a buzzer.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010686323.6A CN111787284A (en) | 2020-07-16 | 2020-07-16 | Data acquisition system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010686323.6A CN111787284A (en) | 2020-07-16 | 2020-07-16 | Data acquisition system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN111787284A true CN111787284A (en) | 2020-10-16 |
Family
ID=72768458
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010686323.6A Pending CN111787284A (en) | 2020-07-16 | 2020-07-16 | Data acquisition system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111787284A (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102968360A (en) * | 2012-11-28 | 2013-03-13 | 青岛海信网络科技股份有限公司 | Storage system with N+1 redundancy function and method |
CN103354503A (en) * | 2013-05-23 | 2013-10-16 | 浙江闪龙科技有限公司 | Cloud storage system capable of automatically detecting and replacing failure nodes and method thereof |
CN203859826U (en) * | 2014-03-13 | 2014-10-01 | 中海油信息科技有限公司 | Integrated video platform |
CN104765749A (en) * | 2014-01-07 | 2015-07-08 | 阿里巴巴集团控股有限公司 | Data storage method and device |
CN207968542U (en) * | 2018-03-26 | 2018-10-12 | 北京神州泰岳软件股份有限公司 | A kind of police service information acquisition system |
CN108984560A (en) * | 2017-06-01 | 2018-12-11 | 杭州海康威视数字技术股份有限公司 | File memory method and device |
-
2020
- 2020-07-16 CN CN202010686323.6A patent/CN111787284A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102968360A (en) * | 2012-11-28 | 2013-03-13 | 青岛海信网络科技股份有限公司 | Storage system with N+1 redundancy function and method |
CN103354503A (en) * | 2013-05-23 | 2013-10-16 | 浙江闪龙科技有限公司 | Cloud storage system capable of automatically detecting and replacing failure nodes and method thereof |
CN104765749A (en) * | 2014-01-07 | 2015-07-08 | 阿里巴巴集团控股有限公司 | Data storage method and device |
CN203859826U (en) * | 2014-03-13 | 2014-10-01 | 中海油信息科技有限公司 | Integrated video platform |
CN108984560A (en) * | 2017-06-01 | 2018-12-11 | 杭州海康威视数字技术股份有限公司 | File memory method and device |
CN207968542U (en) * | 2018-03-26 | 2018-10-12 | 北京神州泰岳软件股份有限公司 | A kind of police service information acquisition system |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106850710B (en) | Data cloud storage system, client terminal, storage server and application method | |
CN110830283B (en) | Fault detection method, device, equipment and system | |
CN103607297A (en) | Fault processing method of computer cluster system | |
CN109784508A (en) | A kind of power grid panorama monitoring operation management method and system based on cloud platform | |
US10868581B2 (en) | Data center management using device identification over power-line | |
CN107968797B (en) | Video transmission method, device and system | |
US20160344582A1 (en) | Call home cluster | |
CN102130759A (en) | Data collection method, data collection device cluster and data collection devices | |
CN106814975A (en) | A kind of memory management method and its system for polymorphic type storage device | |
CN111832943B (en) | Hardware equipment fault management method and device, electronic equipment and storage medium | |
CN112162821A (en) | Container cluster resource monitoring method, device and system | |
CN112217847A (en) | Micro service platform, implementation method thereof, electronic device and storage medium | |
CN113704341A (en) | Data acquisition system and method | |
CA2920430A1 (en) | Managing data feeds | |
CN104253859A (en) | Centralized scheduling resource distributing load balancing device and method | |
CN114338670A (en) | Edge cloud platform and three-level cloud control platform for internet traffic with same | |
CN105743695A (en) | Monitoring method and system based on IEC 104 protocol | |
CN111787284A (en) | Data acquisition system | |
CN104501848A (en) | Data accessing method and system of substation equipment | |
CN112231123A (en) | Message processing method, message processing device, storage medium and electronic device | |
CN104506939A (en) | Information reporting method and television terminal | |
CN109302319B (en) | Message pool distributed cluster and management method thereof | |
CN110365936B (en) | Code stream obtaining method, device and system | |
KR101725192B1 (en) | Resource information management and data storage system through the management of the resource template | |
CN114039836A (en) | Fault processing method and device for Exporter collector |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201016 |
|
RJ01 | Rejection of invention patent application after publication |