CN108961771A - A kind of drink-driving behavior early warning system of the highway based on video analysis - Google Patents

A kind of drink-driving behavior early warning system of the highway based on video analysis Download PDF

Info

Publication number
CN108961771A
CN108961771A CN201810637742.3A CN201810637742A CN108961771A CN 108961771 A CN108961771 A CN 108961771A CN 201810637742 A CN201810637742 A CN 201810637742A CN 108961771 A CN108961771 A CN 108961771A
Authority
CN
China
Prior art keywords
drink
driving
video
vehicle
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810637742.3A
Other languages
Chinese (zh)
Inventor
吕宝贵
陆惠丰
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Municipal Engineering Design Insitute Group Co Ltd
Original Assignee
Shanghai Municipal Engineering Design Insitute Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Municipal Engineering Design Insitute Group Co Ltd filed Critical Shanghai Municipal Engineering Design Insitute Group Co Ltd
Priority to CN201810637742.3A priority Critical patent/CN108961771A/en
Publication of CN108961771A publication Critical patent/CN108961771A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/04Detecting movement of traffic to be counted or controlled using optical or ultrasonic detectors
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/01Detecting movement of traffic to be counted or controlled
    • G08G1/017Detecting movement of traffic to be counted or controlled identifying vehicles
    • G08G1/0175Detecting movement of traffic to be counted or controlled identifying vehicles by photographing vehicles, e.g. when violating traffic rules

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)

Abstract

A kind of drink-driving behavior early warning system the present invention provides highway based on video analysis, it is characterized in that, the following steps are included: video monitoring system, scheduling system, monitoring center, variable information board and information storage system, the video monitoring system includes capture apparatus, drink-driving analysis module, video processing module and alarm module, capture apparatus includes bayonet video monitoring camera, the alert video monitoring camera of electricity, section video monitoring camera and high point monitor camera, the scheduling system includes connecing deal with emergencies and dangerous situations scheduler module and road administration polling module;The present invention has the advantages that track identification judges drink-driving, driving behavior is automatically analyzed, processing is reliable rapidly;For freeway management person's early warning dangerous driving behavior vehicle, it is horizontal to improve Operation and Management of Expressway.

Description

A kind of drink-driving behavior early warning system of the highway based on video analysis
Technical field
A kind of drink-driving behavior the present invention relates to field of traffic control more particularly to highway based on video analysis Early warning system.
Background technique
" People's Republic of China Road Traffic Safety Law " Article 22 the regulation, " spirit for national regulatory of drinking, take Perhaps narcotics perhaps has the disease for interfering safe driving motor vehicle or defatigation to influence safe driving to drug, no Obtain operating motor vehicles."
In fact drinking drive motor vehicle illegal incidents are commonplace, and drunk driving does not only result in vehicle, cargo and the life of driver and passenger Life and property loss also cause road, bridge, tunnel, house etc. to build and build upper attached all kinds of management equipments, mark The damage of label.Highway is different from urban road, because of its closure and the needs continuously driven, halfway without law enforcement people Member carries out drunk driving behavioral value, and the personnel that cause much to drink cherish idea of leaving things to chance, drives into highway after drinking.And highway Because car speed is fast, vehicle amount is big, traffic accident consequence occurs usually than more serious.Traffic accident would generally be to entire road Traffic produce and seriously affect, road can not be restored in the short time, and be easy to cause second accident.
Freeway management at this stage is mainly that monitoring center monitor is managed by video, because of video equipment number Measure more, the work of monitor is laid particular emphasis on to dispatch deal after the accident, lacks effectively observation to vehicle drive behavior.It can To say that existing control of traffic and road means have management blind area for drinking drive behavior, it can not find that in time driving behavior is different Normal vehicle, can not predict driving behavior exception vehicle i.e. by bring harm, can not drink to highway has been swarmed into Driver carries out any management.Traffic accident vehicle can be just only arrested after accident generation, behaviour post-processing of going forward side by side.It is this Processing means can not safeguard road traffic order, it is difficult to retrieve property caused by drunk driving vehicle and human loss.
Summary of the invention
A kind of drink-driving behavior early warning system the object of the present invention is to provide highway based on video analysis is realized Road order is safeguarded in discovery, early warning, guidance to highway drunk driving vehicle is swarmed into the maximum extent, ensures that the people are raw Order property and with freeway infrastructure equipment safety.
To achieve the goals above, the technical scheme is that
1. a kind of drink-driving behavior early warning system of highway based on video analysis, which is characterized in that including
Video monitoring system is connected to monitoring center;
Scheduling system, is connected to monitoring center, carries out safe control to the vehicle to the law enforcement of scheduling high-speed highway and administrative staff System;
The monitoring center, to monitor doubtful drink-driving vehicle, artificial judgment whether drink-driving;
Variable information board is connected to monitoring center, the information that changeable plate face is shown, stops wine to alert drink-driving vehicle Drive for;
Information storage system is connected to monitoring center, to store the driving information of drink-driving vehicle;
Wherein, the video monitoring system includes
Capture apparatus is connected to drink-driving analysis module, to captured in real-time by way of vehicle, and by the video information of shooting It is sent to drink-driving analysis module;
The drink-driving analysis module, is respectively connected to video processing module and alarm module, to vehicle in origin and destination path On driving behavior carry out irrelevance signature analysis, judge doubtful drink-driving behavior, send real-time vehicle to video processing module Video sends enabling signal to alarm module video processing module;
The video processing module, is connected to monitoring center, to intercept doubtful drunk drive from the real-time vehicle video collected The driving information of vehicle is sailed, and is sent to monitoring center;
The alarm module, is connected to monitoring center, to send drink-driving alarm signal to monitoring center.
Further, the scheduling system includes
Scheduler module of dealing with emergencies and dangerous situations is connect, monitoring center is connected to, to communicate with high speed traffic police administrative department, assists high speed traffic police work Make;
Road administration polling module, is connected to monitoring center, to issue inspection order to road administration patrol officer.
Further, the monitoring center includes to receive alarm signal, by the video of the large screen display vehicle With photographic intelligence, in order show subsequent video camera on the vehicle running path, artificial judgment drink-driving, to connecing tune of dealing with emergencies and dangerous situations It spends module and road administration polling module sends dispatch command.
Further, the capture apparatus includes bayonet video monitoring camera, the alert video monitoring camera of electricity, section view Frequency monitor camera and high point monitor camera.
Further, the driving information includes the short-sighted frequency of vehicle behavior and vehicle closeup photograph.
The present invention has the advantages that
1) drink-driving is judged by vehicle driving trace, automatically analyzes the driving behavior of vehicle on highway driver, analyzed Process is reliable rapidly;
2) it is freeway management person's early warning dangerous driving behavior vehicle, realizes the fine-grained management to vehicle on highway, mention High Operation and Management of Expressway is horizontal;
3) information guiding is carried out to drink-driving person and nearby vehicle driver by highway advices plate, can intervened in time Drunk driving behavior, other drivers of the early warning vehicle periphery, avoids highway traffic accident and great life and property loss.
Detailed description of the invention
Fig. 1 is system structure diagram of the invention.
Fig. 2 is overall flow schematic diagram of the present invention;
Fig. 3 is the flow diagram of path monitoring step in the present invention;
Fig. 4 is the flow diagram that tracking step is monitored in the present invention;
Fig. 5 is the idiographic flow schematic diagram of trajectory computation step in the present invention;
Appended drawing reference:
1 video monitoring system, 101 capture apparatus, 102 drink-driving analysis module
103 video processing module, 104 alarm module, 2 monitoring center
3 scheduling systems 301 connect 302 road administration polling module of scheduler module of dealing with emergencies and dangerous situations
4 variable information board, 5 information storage system.
Specific embodiment
Technical solution of the present invention is clearly and completely described below in conjunction with attached drawing, it is clear that described implementation Example is a part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill Personnel's every other embodiment obtained without making creative work, shall fall within the protection scope of the present invention.
A kind of drink-driving behavior early warning system the invention discloses highway based on video analysis, feature exist In as shown in Figure 1, including
Video monitoring system 1 is connected at monitoring center 2, including capture apparatus 101, drink-driving analysis module 102, video Manage module 103 and alarm module 104;
The capture apparatus 101 is connected to drink-driving analysis module 102, captured in real-time by way of vehicle and be sent to drunk drive Sail analysis module 102;
The drink-driving analysis module 102 is respectively connected to video processing module 103 and alarm module 104, is existed according to vehicle Driving behavior on the path of origin and destination carries out irrelevance signature analysis, judges doubtful drink-driving behavior, sends real-time vehicle view Frequency sends enabling signal to alarm module 104 to video processing module 103;
The video processing module 103 is connected to monitoring center 2, the real-time vehicle view sent from drink-driving analysis module 102 The short-sighted frequency and closeup photograph of doubtful drink-driving vehicle are intercepted in frequency, and are sent to monitoring center 2;
The alarm module 104 is connected to monitoring center 2, sends drink-driving alarm signal to monitoring center 2.
As shown in Figure 1, the invention also includes
Scheduling system 3, the scheduling system 3 are connected to monitoring center 2, including connect deal with emergencies and dangerous situations scheduler module 301 and road administration inspection mould Block 302;Wherein, it is described connect scheduler module 301 of dealing with emergencies and dangerous situations and connect built by traffic police department, provide alarm for freeway surveillance and control center 2 Interface establishes collaborative work approach between monitoring center 2 and high speed traffic police administrative department;The road administration polling module 302 by The construction of freeway management department, monitoring center 2 can issue inspection order to road administration patrol officer by road administration cruising inspection system;
The monitoring center 2 by the video and photographic intelligence of the doubtful vehicle of large screen display, and shows the vehicle driving road The realtime graphic of subsequent capture apparatus 101 on diameter, video camera subsequent on the vehicle running path is shown in order, and guaranteeing should The available complete monitoring in form path of vehicle;
Variable information board 4, the variable information board 4 are connected to monitoring center 2, be located at vehicle running path on, for by way of Vehicle carry out information guiding, specifically, variable information board 4 can be changed the display printed words of advices plate, alert drink-driving vehicle Stop drunk driving behavior, prompt the case where there are drink-drivings around other drivers near the vehicle, reach danger early warning Purpose;
Information storage system 5, the information storage system 5 are connected to monitoring center 2, store drink-driving vehicle short-sighted frequency and Closeup photograph carries out illegal activities punishment for doing driving behavior analysis afterwards, and to drink-driving person.
The capture apparatus 101 includes bayonet video monitoring camera, electricity alert video monitoring camera, section video monitoring Video camera and high point monitor camera, the bayonet video monitoring camera, electricity alert video monitoring camera, section video monitoring Video camera, high point monitor camera are built facility along highway, according to highway daily management demand to these Video camera is managed maintenance, it is kept to be communicated with monitoring center 2.
It is public that a kind of high speed may be implemented in a kind of drink-driving behavior early warning system by highway based on video analysis Roadbed is in the drink-driving behavior method for early warning of video analysis, as shown in Figure 2, comprising the following steps:
Step S1) trajectory computation step, shoot by way of vehicle, the driving path of vehicle is obtained, to vehicle in origin and destination path On driving behavior carry out irrelevance signature analysis, determine vehicle whether there is drink-driving, if so, carry out step S2, if It is no, then return step S1;
Step S2) path monitoring step, as shown in figure 3, generating the vehicle including the driving path for monitoring doubtful drink-driving vehicle The short-sighted frequency of behavior and vehicle closeup photograph, and do doubtful alarm;
Step S3) drunk driving judgment step, doubtful alarm signal is received, the vehicle drive information is received, calls vehicle running path Upper subsequent video camera persistently shoots the vehicle, is confirmed again according to the irrelevance signature analysis in step S1, and vehicle is rejected Random evacuation behavior in driving procedure, reduces False Rate, the manual confirmation vehicle whether drunk driving, if so, carrying out step S4; If it is not, then stopping tracking the vehicle, it is back to step S1;
Step S4) monitoring tracking step, as shown in figure 4, scheduling high-speed highway law enfrocement official and road administration inspection inspection personnel are to this Vehicle carries out security control;
Step S5) rale violation warnings step, it alerts the vehicle and stops drunk driving behavior, sails out of highway into service area or nearby, And other drivers provide warning information near the vehicle;
Step S6) information storing step, the driving information of the vehicle is individually stored.
Embodiment: in one embodiment, as shown in figure 5, above-mentioned trajectory computation step through the following steps that realize:
Step S101) background image is selected from sequence of video images, background model is established by ViBe algorithm;
Step S102) it is directed to each vehicle for entering shooting area, it is adjacent in sequence of video images by frame differential method Two frames make calculus of differences, and previous frame image is pk-1 (x, y), and current frame image is pk (x, y);
Step S103) it judges whether there is vehicle and drives into detection zone, if so, jump procedure S104;If it is not, then jump procedure S102;
Step S104) calculate present frame and background frames poor FD (x, y), complete target is extracted from image;Calculate preceding 1 frame With the poor FG (x, y) of background frames, the variable quantity of target is obtained;
Step S105) intersection of asking FD (x, y) Yu FG (x, y), obtain the coarse moving region image of moving target;
Step S106) through mathematical morphological operation, moving region is closed, is continuous, is complete, removes the noise in background;
Step S107) judge whether vehicle sails out of shooting area, if so, jump procedure S108;If it is not, then return step S105;
Step S108) for each vehicle into shooting area, it calculates inlet point position and leaves a position straight line path;
Step S109) it calculates separately in each frame image, the irrelevance between a straight line is left in vehicle location and entrance;
Step S110) judge whether appearance position positive deviation and negative bias reach three times vehicle from number simultaneously, if so, the vehicle For doubtful drink-driving vehicle;If it is not, then the vehicle is not drink-driving vehicle.
Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present invention., rather than its limitations;To the greatest extent Pipe present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: its according to So be possible to modify the technical solutions described in the foregoing embodiments, or to some or all of the technical features into Row equivalent replacement;And these are modified or replaceed, various embodiments of the present invention technology that it does not separate the essence of the corresponding technical solution The range of scheme.

Claims (5)

1. a kind of drink-driving behavior early warning system of highway based on video analysis, which is characterized in that including
Video monitoring system is connected to monitoring center;
Scheduling system, is connected to monitoring center, carries out safe control to the vehicle to the law enforcement of scheduling high-speed highway and administrative staff System;
The monitoring center, to monitor doubtful drink-driving vehicle, artificial judgment whether drink-driving;
Variable information board is connected to monitoring center, the information that changeable plate face is shown, stops wine to alert drink-driving vehicle Drive for;
Information storage system is connected to monitoring center, to store the driving information of drink-driving vehicle;
Wherein, the video monitoring system includes
Capture apparatus is connected to drink-driving analysis module, to captured in real-time by way of vehicle, and by the video information of shooting It is sent to drink-driving analysis module;
The drink-driving analysis module, is respectively connected to video processing module and alarm module, to vehicle in origin and destination path On driving behavior carry out irrelevance signature analysis, judge doubtful drink-driving behavior, send real-time vehicle to video processing module Video sends enabling signal to alarm module video processing module;
The video processing module, is connected to monitoring center, to intercept doubtful drunk drive from the real-time vehicle video collected The driving information of vehicle is sailed, and is sent to monitoring center;
The alarm module, is connected to monitoring center, to send drink-driving alarm signal to monitoring center.
2. a kind of drink-driving behavior early warning system of the highway according to claim 1 based on video analysis, special Sign is that the scheduling system includes
Scheduler module of dealing with emergencies and dangerous situations is connect, monitoring center is connected to, to communicate with high speed traffic police administrative department, assists high speed traffic police work Make;
Road administration polling module, is connected to monitoring center, to issue inspection order to road administration patrol officer.
3. a kind of drink-driving behavior early warning system of the highway according to claim 2 based on video analysis, special Sign is, the monitoring center include to receive alarm signal, by the video and photographic intelligence of the large screen display vehicle, Subsequent video camera on the vehicle running path, artificial judgment drink-driving are shown in order, to connecing deal with emergencies and dangerous situations scheduler module and road Political affairs polling module sends dispatch command.
4. a kind of drink-driving behavior early warning system of the highway according to claim 1 based on video analysis, special Sign is that the capture apparatus includes bayonet video monitoring camera, the alert video monitoring camera of electricity, the camera shooting of section video monitoring Machine and high point monitor camera.
5. a kind of drink-driving behavior early warning system of the highway according to claim 1 based on video analysis, special Sign is that the driving information includes the short-sighted frequency of vehicle behavior and vehicle closeup photograph.
CN201810637742.3A 2018-06-20 2018-06-20 A kind of drink-driving behavior early warning system of the highway based on video analysis Pending CN108961771A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810637742.3A CN108961771A (en) 2018-06-20 2018-06-20 A kind of drink-driving behavior early warning system of the highway based on video analysis

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810637742.3A CN108961771A (en) 2018-06-20 2018-06-20 A kind of drink-driving behavior early warning system of the highway based on video analysis

Publications (1)

Publication Number Publication Date
CN108961771A true CN108961771A (en) 2018-12-07

Family

ID=64490597

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810637742.3A Pending CN108961771A (en) 2018-06-20 2018-06-20 A kind of drink-driving behavior early warning system of the highway based on video analysis

Country Status (1)

Country Link
CN (1) CN108961771A (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111914707A (en) * 2020-07-22 2020-11-10 上海大学 System and method for detecting drunkenness behavior
CN112087595A (en) * 2019-06-14 2020-12-15 广州雷利诺车业有限公司 Intelligent patrol motorcycle and patrol method thereof
CN112782090A (en) * 2020-12-28 2021-05-11 中国科学院长春光学精密机械与物理研究所 Drunk driving automatic monitoring system and detection method
CN113870551A (en) * 2021-08-16 2021-12-31 清华大学 Roadside monitoring system capable of identifying dangerous and non-dangerous driving behaviors

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103268702A (en) * 2013-05-03 2013-08-28 福建工程学院 Method for obtaining evidence of illegal occupying of non-bus vehicles on bus lane
CN203438860U (en) * 2013-07-25 2014-02-19 长安大学 Fatigue driving active monitoring system based on pressure sensor
CN203759874U (en) * 2013-12-23 2014-08-06 安徽皖通科技股份有限公司 Traffic violation information collection system with video enhancement effect
CN104408932A (en) * 2014-11-03 2015-03-11 河海大学常州校区 Drunk driving vehicle detection system based on video monitoring
CN105321352A (en) * 2015-11-16 2016-02-10 深圳市哈工大交通电子技术有限公司 A motor vehicle license plate blocking violation detection and evidence obtaining method
CN107909819A (en) * 2017-12-14 2018-04-13 黄晓丽 A kind of video control device for being used to gather drunk driving vehicle
CN108091136A (en) * 2017-12-14 2018-05-29 阜阳裕晟电子科技有限公司 A kind of drunk driving vehicle detecting system based on video monitoring

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103268702A (en) * 2013-05-03 2013-08-28 福建工程学院 Method for obtaining evidence of illegal occupying of non-bus vehicles on bus lane
CN203438860U (en) * 2013-07-25 2014-02-19 长安大学 Fatigue driving active monitoring system based on pressure sensor
CN203759874U (en) * 2013-12-23 2014-08-06 安徽皖通科技股份有限公司 Traffic violation information collection system with video enhancement effect
CN104408932A (en) * 2014-11-03 2015-03-11 河海大学常州校区 Drunk driving vehicle detection system based on video monitoring
CN105321352A (en) * 2015-11-16 2016-02-10 深圳市哈工大交通电子技术有限公司 A motor vehicle license plate blocking violation detection and evidence obtaining method
CN107909819A (en) * 2017-12-14 2018-04-13 黄晓丽 A kind of video control device for being used to gather drunk driving vehicle
CN108091136A (en) * 2017-12-14 2018-05-29 阜阳裕晟电子科技有限公司 A kind of drunk driving vehicle detecting system based on video monitoring

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
徐贵力,陈智军,郭瑞鹏: "《光电检测技术与***设计》", 31 December 2013 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112087595A (en) * 2019-06-14 2020-12-15 广州雷利诺车业有限公司 Intelligent patrol motorcycle and patrol method thereof
CN111914707A (en) * 2020-07-22 2020-11-10 上海大学 System and method for detecting drunkenness behavior
CN112782090A (en) * 2020-12-28 2021-05-11 中国科学院长春光学精密机械与物理研究所 Drunk driving automatic monitoring system and detection method
CN113870551A (en) * 2021-08-16 2021-12-31 清华大学 Roadside monitoring system capable of identifying dangerous and non-dangerous driving behaviors

Similar Documents

Publication Publication Date Title
CN109146914A (en) A kind of drink-driving behavior method for early warning of the highway based on video analysis
CN108961771A (en) A kind of drink-driving behavior early warning system of the highway based on video analysis
CN101799985B (en) Highway tunnel traffic identification method
CN108919256A (en) Four-dimensional outdoor scene traffic simulation overspeed of vehicle all-the-way tracking detection alarm system and method
CN107481521B (en) The traffic events intelligence means of proof and system based on car networking
CN102081844A (en) Traffic video behavior analyzing and alarming server
CN104809887B (en) A kind of retrograde detection method of vehicle on expressway and autoalarm
CN103886755B (en) Crossing exception parking rapid alarm system and method with the camera function that makes a dash across the red light
CN106327863A (en) Method, device and system for detection and early warning of vehicle congestion
CN106652461A (en) Traffic-management-based information processing method and device, and traffic management system
CN201210353Y (en) Automatic recording system for vehicle
CN104240505A (en) Method for analyzing road traffic video image information
CN106683413A (en) Rapid rescue system based on emergency lane
CN108597225A (en) Intelligent road traffic surveillance and control system and its monitoring method
CN109348179A (en) A kind of road monitoring detection system and method based on artificial intelligence
CN107564295A (en) Intelligence checks the control method for system of deploying to ensure effective monitoring and control of illegal activities
CN109615866A (en) Traffic monitoring system Internet-based
CN111445726A (en) Bridge anti-collision early warning system and method based on distributed video monitoring
CN207068238U (en) A kind of Emergency Vehicle Lane passes through device
CN207068237U (en) A kind of Quick rescue system based on Emergency Vehicle Lane
CN113870551B (en) Road side monitoring system capable of identifying dangerous and non-dangerous driving behaviors
WO2020063866A1 (en) Traffic monitoring and evidence collection system
CN105427618A (en) Method and system for warning in case of vehicle's occupation of emergency parking strip
CN106981200A (en) Urban track traffic intelligent monitor system
CN207938184U (en) A kind of vehicle-mounted act of violating regulations capturing system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20181207

RJ01 Rejection of invention patent application after publication