Pedestrian detector to make roads safer

A new system using two cameras and a processing unit can detect pedestrians in less than 200 milliseconds, allowing it to quickly respond to unsafe situations in real time

A team of German researchers, with the help of a lecturer at the University of Alcala (Spain), has developed a system that locates pedestrians in front of the vehicle using artificial vision.

Soon to be integrated into the top-of-the-range Mercedes vehicles, the device includes two cameras and a unit that process information supplied in real time.

“The new system can detect pedestrians from within vehicles using visible spectrum cameras and can do so even at night”, tells David Fernandez Llorca, of the University of Alcala.

Along with other scientists from the University of Heidelberg and the Max Planck Institute for Informatics, the researcher was involved in the new development for the prototypes of the company Daimler.

The study has been published in the IEEE journal Transactions on Intelligent Transportation Systems.

Watching the road

The device uses of a dense stereo system. The term ‘stereo’ refers to the use of two cameras, which are 30 cm apart in a structure below the rear-view mirror. “Human beings are able to make out the distance and depth of objects thanks to our two eyes - the same occurs with artificial vision,” states the researcher.

“The system is called ‘dense’ because it collects this information from all the points making up each one of the images that the cameras capture,” said Fernández Llorca. When information is collected from just some points, whether they may be very characteristic (like the edges or corners of an object), the term ‘non-dense’ is used.

Dense stereo vision allows for a much more precise real time recognition of the surroundings in front of the vehicle (the shape of the road, the presence of pot holes and variations in contact between the vehicle and the road). Pedestrian recognition is improved compared to non-dense systems included animate objects can be detected in less that 200 milliseconds, like a child who suddenly runs across the road.

How it Works

The two cameras are connected to a processing unit that executes the artificial vision algorithm. The complex hardware has taken years to develop. Images can be seen live on a screen with ‘heads-up displays’ (front transparent screen) or through projections on the inner side of the windscreen. 

Different response elements can also be added to warn or assist the driver. These include alarms that warn of the presence of a pedestrian, break activation systems and even devices that take control of the wheel to avoid knocking someone down.

“It is possible that we will see this pedestrian recognition system very shortly in the new, top-of-the-range Mercedes models,” says Fernandez Llorca.

Other manufacturers like Toyota have also announced that they will soon launch pedestrian detection stereo systems onto the market.

-Mumbai Mirror