| 7:00 AM EST

How Would This Automated Vehicle System Have Handled Elvis?

What part of the body can be predictive of where a person might move? One answer: the pelvis


Facebook Share Icon LinkedIn Share Icon Twitter Share Icon Share by EMail icon Print Icon

One of the big issues related to automated vehicles is dealing with people. No, not the people who are inside the vehicles and who might do all manner of untoward things while on the inside of one of those toaster-shaped units, but the people who are out on the streets.

AKA, pedestrians.

A Motion Prediction Solution for Autonomous Vehicles

Analysts at the Southwest Research Institute (SwRI) may be close to a solution. They’re applying machine learning to human behavior.

Specifically, they’ve created a motion prediction system. It uses computer vision to feed information into a deep learning algorithm. By watching biomechanical movements in real time, the system can predict what the next move might be.

SwRI predictive image

What the SwRI system “sees.” The blue dot is where the system anticipates the person will be going. (Image: Southwest Research Institute)

To do this, it focuses on the pelvic area.

Explains Samuel E. Slocum, a senior research analyst who led the internally funded project at SwRI, “For instance, if a pedestrian is walking west, the system can predict if that person will suddenly turn south.”


Applying Sports Science

Well, other research approaches use “optical flow” algorithms to figure out where people might be going. The speed and direction are determined based on lateral motion. However, this system’s accuracy diminishes when people make an unexpected move.

The SwRI researchers are using a temporal convolutional network (TCN) to process the video data that is collected by SwRI’s markerless motion capture system, which automates biomechanical analysis in sports science as it combines camera vision and perception algorithms. Just as athletes can make sudden moves, so too can your average 10-year-old on the side of the road.

They are also using a convolutional neural network that learns and predicts trends over time.

If we see a pedestrian, we might prepare to slow down or change lanes in anticipation of someone crossing the street.

Notes Dr. Douglas Brooks, a manager in SwRI’s Applied Sensing Department, “If we see a pedestrian, we might prepare to slow down or change lanes in anticipation of someone crossing the street. We take it for granted, but it’s incredibly complex for a computer to process this scene and predict scenarios.”

And what we take for granted is going to somehow have to be coded into an automated driving system.



  • 9 Ways Additive Manufacturing Rises to the Advanced Mobility Challenge

    Additive manufacturing (AM) is just one manufacturing method that drives advanced mobility forward and also has a history of embracing the digital connectivity demanded by this trend.

  • How 3,000 Is a Really Big Number

    To know that 3,000 cars have been delivered since October 2015 would undoubtedly result in a shrug: in 2017 Toyota delivered 387,081 Camrys, so that 3,000 is less than one percent, and this is in one year, not just over two.

  • Bill Gates Meets LiDAR

    While there is a burgeoning proliferation of companies that are in the LiDAR space, each with its own take on utilizing laser pulses to create a precise map of its surroundings for purposes of ADAS or full-blown automation, a Seattle-based company has a distinction that certainly sets it apart from its competitors.