What kind of Computer Vision Engineer are you?

If you look at the image above, you'll notice that the engineers on the right seem to be capable of much more than those on the left, when it comes to detecting objects.
And yet, these two images are produced by Computer Vision Engineers, and they were both asked to run "object detection". But one engineer was doing it in 2D, while the other was doing it in 3D.
Okay, but why would we be interested in 3D?
ππΌ Back when I was creating the v1 of this Stereo Vision course in late 2020, an engineer from my audience named Matt contacted me and asked:
"How can I become a Computer Vision Engineer at Tesla?"
This question felt like a trap.
Was he seriously asking me how he could join one of the most advanced and exclusive companies in the autonomous tech field?
I needed to find out more, so I asked:
- "What can you do in Computer Vision?"
- "All the basics, image processing, object detection, segmentation, ..." he replied
And the next question that came into my mind was:
- "Can you work in 3D?"
He nodded, with a bit of confusion.
But why did I ask this question?
A couple of years ago, I wouldn't have.
But after years of experience as a self-driving car engineer, and helping engineers get their dream job in cutting-edge companies, I learned quite a few things. I also got to talk to lots of self-driving car companies, and identified recurring elements in these.
One of these elements is also present in a job offer for Computer Vision Engineer in the Tesla Autopilot Team:

Did you see it? Yes! While most of the skills are just related to coding, maths or linux, the only Computer Vision skills they're interested in are 3D Computer Vision skills!
And the list of skills can be terrifying: Intrinsic and Extrinsic Calibration; Homogeneous Coordinates; Projection Matrices; Epipolar Geometry; 3D Reconstruction; Structure From Motion; Visual Odometryβ¦
What's all of this?
These are the skills that make the difference between the 2D engineers on the left image from before, and the 3D engineers on the right one.
While 2D Engineers don't even know these skills exist, and focus on YOLO YOLO YOLO, 3D Engineers build very advanced projects inside the coolest companies.
I decided to send this job offer to Matt, and highlight the part showing 3D. He seemed uninterested at first, but came back a few days later telling me he'd decided to put that on his list.
Is Matt going to learn 3D Computer Vision and immediately be hired at Tesla? I doubt it. It's unlikely in general to work there. Yet, if Matt built 3D Computer Vision skills, he could work in TONS of startups building 3D Computer Vision projects...
But do you really need these? Can't you stick to 2D?
Okay, let's assume we do stick to 2D skills.
And let's say we're working as an engineer doing object detection for a self-driving car startup. One of the first things you'll do is probably to implement the YOLO algorithm, that is doing object detection.
And after a few hours, you'll have a ready to run model, giving you some information, like for example the information that there is a car pixel (438, 237).
But what is your company gonna do with that?
Eventually, this information will need to be correlated to a distance to our ego car, a direction and orientation, and therefore as a 3D position.
Without 3D, you'll just be good to run 2D algorithms, and send them to the 3D people, that can by the way also do 2D.
And this is why 3D Engineers are hunted by robotics and computer vision companies... while 2D engineers patiently wait in line.
In fact, for these companies, 2D skills are implied, and sometimes not even listed on resumes or job offers!
If we go further, 3D skills are not only more useful to companies, but also more impressive to recruiters, or in your portfolio.
And it opens more doors:
Imagine you're playing at the lottery, and you suddenly won a week of vacation at the Royal Atlantis in the Bahamas, which is one of the most beautiful hotels on the island. You can already feel it, the sun on your skin, the luxurious room with a sea view, the shark pool⦠it's going to be a great week.
A week later, you check in at the counter after a long flight, and the receptionist asks: "Which room do you want? Our Royal Imperial Suite is available." That's almost too good to be true. But hey, you won the game! And so you pick the room and have a fantastic week.
Now, what if the receptionist asked: "Which room do you want? You can have any of our standard rooms at the ground floor." Huuh. It doesn't feel the same. What about the most beautiful suite? Is it taken?
Yes, it is. By the 3D Engineers.
When you're sticking to 2D, it's exactly as if you were limiting yourself to only the ground floor. And as soon as you start getting 3D skills, you're starting to get access to the most luxurious villas of the hotel // the most advanced startups, working on the coolest projects.
Whether you're planning to work on Computer Vision at Tesla, on Apple's Object Capture algorithm, or in the latest autonomous robot and drone startups, they work in 3D.
But how to learn about 3D Computer Vision?
I've seen hundreds of students try to learn about 3D Computer Vision, and suddenly get overwhelmed with a gigantic amount of PDFs from 1993, outdated lectures, and yes, boring content everywhere.
3D Computer Vision is one of the most difficult topics in Computer Vision... and no course was covering it right!
Until now:













