A new highway incident detection algorithm is proposed based on a perception theory of dual perspectives.The epi-polar plane image (EPI)features with each separate traffic lane were developed,which described the overall characteristics of traffic in each pre-defined lane.When fused with the separated behavior of each vehicle trajectories,the higher performance as well as lower complexity with algorithm is achieved based on the integrated dual perspective perceiving framework.Extensive experimental results with variety of typical traffic incidents (such as traffic congestion,retrograde driving vehicles,vehicle parking violations,and traffic collisions)showed that this new highway incident detection algorithm has the detection rate 94.09%,the false detection rate 4.51%, and the false negative rate1.40%.