Think Autonomous

375€ or 2 x 189€

MASTER 4D PERCEPTION: Ultimate 3D Tracking Skills for Perception Engineers

Learn 3D Object Detection, 3D Tracking, and Build Advanced 4D Perception Projects

This course is now closed and will open at Fall 2026. Make sure to join the waitlist to get goodies and be notified while you're waiting.

Join Waitlist →
Master 4D Perception course cover

Autonomous Shuttle Engineer Launches the First Ever 4D Perception Course made for Engineers looking to build cutting-edge skills that STAND OUT!

Dear Perception Engineer:

If you would like to learn how to build the 4D Perception algorithms that the top self-driving car companies like Zoox, Cruise, or even Waymo are working on, then this page will show you how...

Here's a story:

One day of 2017, I have been invited to an interview with an autonomous tech company.

The company was specialized in submarines, robots, aircrafts, military equipment, and somehow — I made it to the technical interview.

And of course, I brought many of my projects!
I needed to "show" them what I could do, I needed to be visual, I needed to drive home incredible results!
So I showed them a lane line detection algorithm I've learned through an online course.

"How did you build this?" he asked

Inexperienced, I started to mumble, and ended up sharing some details, including how I've used OpenCV functions such as Canny Edge Detection or the Sobel Operator.

... the recruiter stayed silent...

Any question?

Suddenly, he starts to have a blast. "Hahaha! the SOBEL?! Nobody's been doing this for over 20 years! Where did you learn this?!"

I felt ashamed. How could I not know this? And the recruiter wasn't a bad one; he was fascinating. But I simply wasn't "connected" enough to the industry, and what the companies were doing at the moment.

Could that ever happen to you?

What if it did? Are your projects advanced and relevant enough?

When you start looking around, you'll see a bunch of weird differences between the projects shared by engineers online, and what companies are actually looking for. Things like:

It evolves so fast... it's easy to learn something and not realize you're completely off the mark.

In a couple of years, we've moved from YOLO, basic Sensor Fusion algorithms, and A* based planners...
... To FMCW LiDARs, 3D Object Detection and Tracking, Reinforcement Learning, and even now Transformer based architectures.

But if you want to work in the Perception field, you should start paying attention to what Perception Teams do.

What do they do?

3D perception at a self-driving car company

Look at what top self-driving car companies like Waymo, Zoox, or even Cruise are working on and sharing online:

Can you see it? It's all 3D! And it's even tracking objects and predicting their future trajectories!

Look no further. This is what their perception teams work on: 3D Object Detection & Tracking.

And I'd argue most of the related fields, such as robotics, drones, and others, are on the forefront of this too.

This is the field of 4D!
It's fascinating, but it's also one of the hardest.
One of the things I've noticed in the past few months is how little the 3D Object Detection and Tracking field is documented. There is a clear LACK of overview, easy-to-understand code, and courses.

Many engineers have no simple way to learn how to build these skills, other than reading dozens of research papers and getting bogged down for hours in GitHub repos. Reading blog posts after blog posts, many of them contradicting themselves, and leading nowhere.
And this can take months...

Until now:

INTRODUCING...

MASTER 4D PERCEPTION: Ultimate 3D Tracking Skills for Perception Engineers

In this course, we're going to learn how to build radically advanced skills in the 4th dimension, so let's see the program:

Master 4D Perception course cover

Module 1

3D Object Detection

We'll begin the course right with 3D Object Detection. Many engineers know how 2D Object Detection works, but almost nobody knows how 3D Object Detection works.

Whether it's on cameras or LiDARs, this is a largely unexplored field, and it's time to pioneer it.

3D Object Detection

What you'll learn

Point-RCNN 3D object detection

Want to see the project you'll build?

This is cool, because you'll learn to load a point cloud, run several different object detectors, visualize the results, and even compare with multiple labels.

Your project will look like this:

3D Object Detection project

Honestly, I could have stopped there.

3D Object Detection is a fascinating enough topic. And building a 3D Object Detection course would have been a great idea already.

But I didn't want to. I wanted you to get exactly what the self-driving car companies do: 4D. So I built 2 more modules...

Module 2

3D Association & Fusion

Now we're going to the heart of the course: 3D Association & Sensor Fusion. You will learn how to merge 3D Bounding Boxes from frame to frame, or from sensor to sensor!

In this module, we'll try to match bounding boxes from 2 consecutive frames. We'll see cost functions related to the 3D field...

3D association in a Colab notebook

So here's a preview of what's included in Module 2

Therefore, it implies we'll see

In this last point, I'll show you a 3D Object Tracker that has been able to get over 200 FPS, and beat any other tracking algorithm.

This matters, because in 3D, and in particular with point clouds, we have a LOT MORE things to process. If you're comparing point clouds inside bounding boxes for example, you may end up with an algorithm running at just a few FPS. And if all you do is a basic euclidean distance, your algorithm may be too simple to succeed.

In this module, we'll see a winning combination that makes algorithms not only incredibly fast... but also accurate to the point of winning State-Of-The-Art Leaderboards!

But it's not all we do, we'll also see advanced techniques in Module 3:

Module 3

3D Object Tracking

In the final module, you will build your 4D Perception project. How to engineer a system that detects objects in 3D, assign IDs to them, and track them all along a sequence?

3D Object Tracking

What you'll learn

About the project...

4D Perception project

Here's what you'll learn to do!

4D Perception & LiDAR Object Tracking on a Highway scenario

4D Perception and LiDAR Object Tracking on a Highway scenario

This project is advanced, and as I said, it has been built to be similar to what real self-driving car companies do.

It's also 100% customizable, and can be adapted to any self-driving car Dataset (see Waymo below) with almost no code modification.

Enroll in 4D PERCEPTION

Want to see how I teach Tracking?

Here are some reviews from my 2 other tracking courses (on Obstacle Tracking & Kalman Filters), and then we'll explore some on 4D Perception:

FROM THE EDGENEERS

Testimonials

"Really liked it"

"I recently completed the updated version of your obstacle tracking course. Really liked it.

I liked that you gave a quick walkthrough of all the major 2D OD networks. I also liked the part where we used additional metrics and not just IOU for our hungarian matching.

Lastly, what better than seeing all of this being put into action on a live video?"

Mohammad Anas KhanCSE Upcoming SWE Intern @Google · Obstacle Tracking review

"Exactly what I was looking for"

"This is a great course and it is exactly what I was looking for! I've done many Kalman courses in the past but the example with the bicycle really opened my eyes.

To be honest I played with the code quite a few hours and could develop a really good understanding how a Kalman filter works.

Thanks a lot!"

Ivo Germann
Ivo GermannDevelopment engineer R&D, Project leader bei Zumbach AG · Kalman Filter review

"I got the thing which I am missing as advanced stuff in my resume to shortlist myself."

Before purchasing the course, I was doubting because of the course fee wrt Indian purchasing power parity (it's my father's 1 monthly salary.. to give you context and also the income per person in India).

But I got the thing which I am missing as advanced stuff in my resume to shortlist myself. I really liked the project Implementation and simplicity of course page. Now I have an advanced project to keep in my resume, and your emails made me keep a high standard for myself. It also made me keep you as my role model to be proficient in CV space in India in the next 2 years.

I thank you very much, because what I was looking for was found here in structured and guided manner, where I can't find elsewhere for sure.

I would definitely recommend. Thank you very much Jeremy..

MLV Prasad
MLV PrasadData Science and analytics - Mentor @codingInvaders · 4D Perception review

This engineer completed the course and shared it online, here are the results...

LinkedIn post of the 4D Perception project
The same post re-shared by another channel

You think 297 likes is a lot of attention?

Well, his post has been re-shared by another channel, and look at the results!

THIS IS THE POWER OF 4D PERCEPTION!

STOP! Before enrolling, you should know these things:

First, this course is advanced, and has some prerequisites — most won't be able to join.

(Mandatory) So here are some prerequisites:

(Optional) You should also be familiar with the following:

The second half is optional, but highly recommended. This course has been built for an intermediate/advanced level, and therefore I won't reexplain every beginner concept.

And even though I included lots of reminders, in particular in Kalman Filters and other association techniques, enrolling without the prerequisites is not advised.

In fact, I recommend engineers who have never experimented with 2D Object Detection or Tracking to simply not enroll. I have courses to master these techniques too, and I recommend you go through them first.

Plus, if you have never done any kind of 2D Tracking... Why start with 3D?

About the duration and format:

This course isn't video only. It's always a hybrid of videos, text, stories, keynotes, papers, mindmaps, images, memes, code, notebook, interviews, and tutorials, ... I'm personally not a fan of video-only courses, especially when they're looooong. So I do the opposite and add lots of text, images, etc.. so your visual memory gets activated too.

🚀 For projects, the main format is notebooks and videos, all done on Colab with nothing to setup (yes! even for the 3D Visualizer)

About the duration: It probably depends on your prerequisites. If you validate the prerequisites, you'll be able to go fast. Still, 3D Object Detection and Tracking is HARD and in particular, the 3D Object Detection module will be very complete.
⏳ Plan somewhere between 10 and 15 hours (or more) to go through it.

You may or may not be "there" yet. How can you know?

While this course could totally change the career of many engineers, helping you totally stand out and be seen as a master of the Perception field; it can be totally optional for others.

It's important to understand which side you're on before taking it.

I recommend not to join if:

On the other hand, this course has been designed for you if:

If you identify in the second half, I'll give more precision about enrollment below.

  1. 4D PERCEPTION
    • Advanced
    • Images, Point Clouds
    • 3D Multi-Object Tracking
  2. KALMAN FILTERS
    • Beginner/Intermediate
    • Sensor Agnostic
    • Bayesian Filtering
  3. OBJECT TRACKER
    • Beginner/Intermediate
    • Images
    • Multi-Object Tracking
The Think Autonomous Tracking Journey

One more question:

"What is the difference between this course, and your other tracking courses?"

The main difference is that this course focuses more on 3D Object Detection, Visualization, and Tracking than anything else. It's also the most advanced, which implies the skills acquired are more rare.

If you'd like to compare the two together, let's run a side-by-side comparison of 2D vs 3D Object Tracking, on the same sequence:

2D MOT
2D MOT
3D MOT
3D MOT

☄️

This 4D Perception course is unique, but it also has an incredible advantage...

Do you remember in Harry Potter 6 when Harry finds the book of the half-blood prince? Suddenly, he gets incredible grades at school, and is even the only student that wins the Felix Felicis potion. He becomes his teacher's favourite student...

He stands out!

This 4D Perception course is like the half-blood prince's book — with it, you're going to learn algorithms most of the others don't know, such as 3D Object Detection, 3D Fusion, and 3D Tracking, and you'll build your own 3D Visualizer, that will help you stand out.

But the biggest advantage? The visualizer!

There's a good underlying reason why most self-driving car companies share their work using 3D Visualizers and not just images. It's because Point Clouds and 3D Data is always more eye-catching to the human eye. This has been proved by hundreds of engineers and content creators on LinkedIn, even demonstrated in some posts.

And with this Visualizer, you will be able to build custom projects for this course... but also for all your other Perception courses! In fact, this visualizer is adaptable to other projects, such as aerial navigation and ground robotics.

But how much can you really stand out sharing a 4D Perception Project?
4D implies you know both 2D and 3D, it implies you've been paying attention to what the field is doing, and more importantly...

It gives you that credibility that can make the difference in an interview. It shows recruiters you're part of their world.

On that note, below is the button to enroll:

MASTER 4D PERCEPTION

Ultimate 3D Tracking Skills for Perception Engineers

4D Perception waitlist: Goodie 1, How Self-Driving Car Engineers use YOLO in a real world self-driving car environment

4D Perception Waitlist

Join the waitlist and get immediate access to Goodie #1

When you join the waitlist, you get access to a series of exclusive 3D Tracking goodies on Robotics & Self-Driving Car Perception

  1. How Self-Driving Car Engineers use YOLO in Real-World Perception Environment [Immediate]
  2. [Case Study] How to get a job in Autonomous Defense & Delivery using Drone Tracking
  3. Object Detection: How to "tweak" Faster-RCNN to Build LiDAR/RADAR Detectors
  4. 2D and 3D Multi-Object Tracking Roadmap (4 Essential Steps)

STATUS: Waitlist Open - Join to Get Goodie #1

Your information is secure and won't be shared

In this course, we're going to learn how to build radically advanced skills in the 4th dimension.
375€ or 2 x 189€