Thereβs a HUMAN inside Tesla FSD 12.3
Summary
TLDRThe video script offers an insightful analysis of Tesla's Full Self-Driving (FSD) technology, highlighting the significant improvements in version 12.3. The AI demonstrates a more human-like driving behavior, particularly in handling unprotected turns and maintaining consistent speed. Despite some critical disengagements due to road closure misunderstandings, the overall performance is promising, suggesting that with continued updates, FSD could become even more reliable and user-friendly.
Takeaways
- π Version 12 of Full Self-Driving (FSD) technology shows significant improvement in driving like a human, with more natural and predictable behavior.
- π£οΈ The car's performance in unmarked intersections and parking lots has greatly improved, showing cautious and patient behavior, similar to that of a human driver.
- πΆ The FSD beta effectively yields to pedestrians, demonstrating a good understanding of their movements and prioritizing safety.
- π¦ The vehicle handles unprotected turns with more caution, creeping out to ensure visibility of oncoming traffic before proceeding.
- ππ The car still faces challenges with road closures, resulting in critical disengagements when it attempts to navigate through them.
- ππ¨βπΌ There were instances where the car's automatic emergency braking system intervened, showing that safety systems are actively working to prevent potential accidents.
- π The overall speed maintenance and consistency have improved, making the ride smoother and more enjoyable.
- π« The car still requires human intervention for certain maneuvers, such as making a U-turn in a small space or navigating through road closures.
- π The FSD beta's ability to anticipate other drivers' actions and react smoothly to unexpected situations is a notable improvement.
- π¨ Despite the advancements, there are still areas that need refinement, particularly in understanding and reacting appropriately to road closure situations.
- π With the rapid pace of improvement from version 12.2 to 12.3, expectations are high for the future capabilities and release of FSD technology.
Q & A
What is the main topic of the video transcript?
-The main topic of the video transcript is the evaluation of Tesla's Full Self-Driving (FSD) version 12.3, focusing on its performance in various driving scenarios and comparing it to previous versions.
What are the two possible reasons the narrator considers for the slow rollout of version 12 of FSD?
-The two possible reasons the narrator considers are that either the new approach using human data to train a generalized driving AI is working, or Tesla employees are remotely driving all the cars from their offices.
How does the narrator describe the parking lot performance of FSD version 12.3?
-The narrator describes the parking lot performance as improved, with the FSD version 12.3 being able to handle complex situations like unmarked intersections and interacting with pedestrians more effectively than before.
What is the narrator's opinion on the potential release of Smart Summon in future FSD updates?
-The narrator is excited about the possibility of Smart Summon being introduced in future FSD updates, as it could further enhance the convenience and capabilities of the self-driving system.
How does FSD version 12.3 handle unprotected turns compared to version 11?
-FSD version 12.3 handles unprotected turns more cautiously and naturally, creeping forward to get a good view of incoming traffic before proceeding, whereas version 11 had more trouble with these types of turns.
What is the narrator's view on the AI's ability to handle a situation with a pedestrian crossing unexpectedly?
-The narrator believes that the AI handled the unexpected pedestrian crossing situation better than a human driver might have, showing an improved understanding and reaction time compared to previous versions.
What are the critical disengagements mentioned in the transcript, and what was the common issue?
-The critical disengagements were instances where the FSD system would have gotten into trouble without human intervention. The common issue was the system's inability to properly handle or understand road closures.
How does the narrator describe the automatic emergency braking system in FSD version 12.3?
-The narrator mentions that the automatic emergency braking system in FSD version 12.3 seems to have been turned up, leading to an incident where the car skidded to a stop while trying to navigate a tight gap.
What is the narrator's overall impression of FSD version 12.3 after the test drive?
-The narrator is impressed with the improvements in FSD version 12.3, particularly in maintaining consistent speed, handling unprotected turns more naturally, and exhibiting more human-like behavior. However, they also note the critical disengagements related to road closures.
What feature from previous FSD versions does the narrator miss in version 12.3?
-The narrator misses the models for objects like trash cans and cones from previous FSD versions. In version 12.3, these have been replaced with blobs, which, while not as visually appealing, provide more information for the driver.
What does the narrator suggest as a potential future improvement for FSD?
-The narrator suggests that the ability for FSD to reverse and perform actions like three-point turns on its own would be a significant future improvement, as it would resolve some of the non-critical disengagements experienced during the test drive.
Outlines
π Introducing Version 12: A Leap Forward in Full Self-Driving
The video begins with a discussion on the new approach to training a generalized driving AI using human data, highlighting the improvements in Tesla's Full Self-Driving (FSD) version 12. The host shares their belief that this version feels the most human-like yet, with notable advancements in parking lot navigation and handling unmarked intersections. Excitement is expressed over the potential release of Smart Summon in future iOS app updates and the possible return of Auto Park. The video showcases how the car confidently handles complex situations such as navigating through a busy parking lot, dealing with pedestrians, and managing tight gaps, emphasizing the significant leap in capability compared to previous versions.
π Version 12's Enhanced Perception and Decision Making
This paragraph delves into the enhanced perception capabilities of FSD version 12, noting the replacement of detailed models with 'blobs' for objects like trash cans and cones, which surprisingly offer more information. The host discusses the car's ability to handle complex situations such as road closures and unprotected turns, highlighting the car's cautious approach and improved decision-making. A particular focus is on the car's interaction with pedestrians and other vehicles, showcasing how the FSD beta can anticipate and react to their movements more effectively than earlier versions. The host also expresses gratitude towards Patreon supporters, attributing the improved video production quality to their contributions.
π£οΈ Navigating Challenges: Road Closures and Construction Zones
The host discusses the challenges faced by FSD version 12 when dealing with road closures and construction zones. Despite the car's improved capabilities, it still struggles with understanding and reacting appropriately to road closures, leading to a few critical disengagements. The video provides examples of these situations, including the car's inability to perform a U-turn in a small space and its difficulty in rerouting around obstacles. However, the host remains optimistic about the future improvements, particularly once the car gains the ability to reverse on its own, which is expected to significantly enhance its navigational skills.
πΆββοΈ Improved Pedestrian Interactions and Human-like Driving Behaviors
This section of the script focuses on the remarkable improvements in the car's interaction with pedestrians and its adoption of human-like driving behaviors. The host narrates instances where the car exhibits politeness andι’ε€, such as allowing a car to merge or waiting for pedestrians to cross, even when they might not be expected. The video also highlights the car's ability to handle complex traffic situations, like navigating through a roundabout and making unprotected turns, with a level of caution and decision-making that closely mimics human drivers. The host expresses their amazement at the car's ability to read and respond to traffic signs, such as 'no right on red', and its overall progress in safety and predictability.
π Version 12.3: A Comprehensive Review and Future Expectations
In the concluding paragraph, the host provides a comprehensive review of FSD version 12.3, summarizing the significant improvements made over the previous version. They note the car's enhanced ability to maintain consistent speeds and handle unprotected turns more naturally, as well as its increased human-like behavior in traffic situations. The host acknowledges the three critical disengagements related to road closures and the four non-critical disengagements, suggesting that these issues are fixable and will likely be resolved with future updates. They express optimism about the rapid pace of improvement and the potential for full self-driving capabilities in the near future, while also contemplating the need for new ideas for their YouTube channel as the technology advances.
Mindmap
Keywords
π‘Full Self-Driving (FSD)
π‘Human Data
π‘Parking Lot Performance
π‘Unprotected Turns
π‘Critical Disengagements
π‘Non-Critical Disengagements
π‘Automatic Emergency Braking
π‘Visualization
π‘Road Closures
π‘Improvement Rate
Highlights
The new approach using human data to train a generalized driving AI seems to be working, making the full self-driving (FSD) version 12 feel more human-like in its driving behavior.
FSD version 12 has shown improvements in parking lot performance and handling unmarked intersections, showcasing its ability to wait out complex situations with multiple actors involved.
Leaks in the iOS app updates suggest that Smart Summon may be coming soon, which would be a significant addition to the FSD features.
The FSD beta has demonstrated a more natural and smooth driving manner, avoiding the slow creep that signals intent to other drivers, thus feeling more competent.
Pedestrian interactions have seen considerable improvement, with the FSD beta yielding well for pedestrians, even in situations where the human driver might not have been as accommodating.
The FSD beta managed a complex maneuver of crossing multiple lanes to make a left turn at a light, showcasing its understanding of traffic patterns and lane discipline.
There's a notable difference in the way version 12 handles right turns at lights, with the system displaying more caution and better anticipation of traffic conditions.
The FSD beta's ability to handle unprotected turns has improved, with more cautious and human-like behavior, making it a safer and more predictable driver.
The beta's reaction to a pedestrian crossing in front of the car was well-handled, even when the human driver did not see the pedestrian until editing the video.
The FSD beta's automatic emergency braking system was triggered during a tight gap maneuver, demonstrating the safety systems' vigilance despite the beta's capability to handle such situations.
The beta's visualization system has replaced models for objects like trash cans and cones with blobs, which, while less aesthetically pleasing, provide more useful information for understanding the car's surroundings.
The FSD beta exhibited a better understanding of road closures and navigated more cautiously, although it still struggled with certain road closure scenarios.
The beta's ability to anticipate and smoothly handle the movements of other vehicles, even when they are indecisive or unexpected, showcases its advanced understanding of traffic dynamics.
The FSD beta's handling of a tough unprotected left turn, with its cautious creeping behavior and good visibility management, demonstrates a significant improvement over previous versions.
The beta's decision-making during a yellow light, choosing to accelerate through the intersection after initially braking, shows its capability to make quick, human-like judgments.
The FSD beta's navigation and driving behavior, particularly in complex situations like road closures and construction zones, indicate that while it has made great strides, there is still room for improvement.
The overall improvements from version 12.2 to 12.3 are substantial, suggesting that if this rate of enhancement continues, the future of full self-driving looks promising.
Transcripts
after watching this drive through San
Jose I think you'll agree one of two
things about full self-driving is true
either the new approach using human data
to train a generalized driving AI is
working or the reason version 12 has
been so slow to roll out is because
Tesla employees are the ones remote
driving all the cars from their offices
in all seriousness this really is the
most human feeling version of FSD yet
and there's some moments in this drive
you're going to have to see to believe
the first thing it's going to have to do
is escape this parking lot you can see
it pull up to this intersection pretty
cautiously and there's an approaching
car from our leftand side and also
someone leaving their parking spot from
the right hand side so it does decide to
wait it out parking lot performance in
general and especially the performance
in these unmarked intersections has
gotten really really good and I've also
seen some leaks in the IOS app updates
where it looks like actually smart
summon could be coming very soon which I
am super excited to try out and I'm also
excited that we're probably going to get
Auto Park back too you can see another
driver ahead of us leaving their parking
spot and what I love here is that it's
not coming to a full stop and doing a
slow 1 or 2 mph creep the entire time
and I know that may not seem like much
but creeping slowly really does show a
lot of intent to other drivers which is
what they're used to and makes it feel a
lot more competent there's a pedestrian
on the right hand side who just walks
out without a care in the world she
never looked back or anything I think
don't think she has a clue where here
but uh the beta does a great job
yielding for her I know there's a lot of
humans out there that wouldn't have been
quite as nice in this situation the exit
of this parking lot is unfortunately one
that is very common around here but one
that I do not like which is this
intersection right where the entrance is
it could be pretty tough to escape a
situation like this but luckily there's
a pedestrian who's walking across in
front of the car to the left and it
actually takes this opportunity and goes
for it this was extremely well done it
CH a perfect moment to pull out and this
is something that version 11 had quite a
bit of trouble with it would have been
yielding to pretty much every vehicle in
the scene now as we approach this
unprotected turn you may notice that our
leftand turn signal is on for this right
turn you can see on the navigation it
definitely knows that it has to make a
right turn but yet it has the left turn
signal on that is because we have to
make a left turn at the light which
means as soon as we get out of this
parking lot we're going to have to cross
over multiple Lanes to get all the way
over into that leftand turn lane and as
soon as traffic clears it goes ahead and
makes its move and Crosses all four
lanes at once and gets us all the way
into the leftand turn lane very well
done and I know there is going to be
some complaints about it crossing a
solid white line which we all know is
punishable by death in all 50 states so
go ahead and cry about it in the
comments now you may be able to just
barely make out this pedestrian on the
visual visualizations that I in the car
did not see at all so I thought this
person turning right was just stopping
in the road for absolutely no reason
here I did not see The Pedestrian
Crossing in front of him at all this is
one of those scenarios where I feel like
the car may have had a little bit better
of an understanding of what was going on
than I did in the car because I didn't
even know that pedestrian was there
until I started editing this video and
while that maneuver was very well
handled and very smooth I might add the
next one was definitely not we have a
right turn to make it the light ahead
and you can see a human driver squeezing
the gap between the trash can and the
car next to it and I could not believe
autopilot was about to try the same
thing but it did I'm going to let you
watch what happens
here oh my
God it actually triggers the car's
automatic emergency breaking and makes
it skid to a stop this is definitely
worth taking a closer look at that is
definitely a first for the channel you
can see that the Gap is pretty tight
here but we have seen version 12 shoot
tighter gaps in the past but I think it
was because it was heading towards the
SUV to the left as it was passing the
trash can that triggered it now you
might not know this but there was
actually another incident on version 12
that somebody recorded a it tapping
another car's bumper in a parking lot so
I have a feeling that may be the reason
that the automatic emergency braking has
been turned up to 11 here now to be
honest I'm not really sure what to file
this disengagement under I'm going to go
ahead and call it a non-critical
disengagement because to be honest I
think the car had it handled I think it
would have completed that maneuver just
fine but it was the automatic emergency
systems that overrode its decision and
brought it to an abrupt stop I seem to
believe in version 12's abilities even
more than the car does we do go ahead
and pull off to the side of the road
because we have reached our destination
and I go ahead and put another one in
and re-engage while the car is doing its
best to try to get around this trash can
here I think it's interesting to point
out that the models for a lot of things
including trash cans and cones and all
that are completely gone with version 12
you can see they've been replaced with
kind of just blobs that show up on the
visualization and although the blobs
might look a little bit ugly I think
they actually give you a little bit more
information and I'm hoping that they
take over the entire driving
visualization someday now we we have a
left turn to make here but as you may be
able to see off to the left the road is
closed there is enough room to get
around those cones though so let's see
what it wants to do here you can see a
very slow creep into the intersection I
almost feel like it knows it shouldn't
turn left here but it's still trying to
figure out a way to do it and it sits
here for quite a while until a car
approaches from behind us and at that
point it goes for it which does cause
our first critical disengagement because
unlike the last video where the road
closure said Road closed except for
local traffic this one is a real road
closure and I did not want to interrupt
whatever was going on over there so
looks like it's still having a bit of
trouble in those road closure situations
it's funny in all the road closures I
put it in it almost feels like it knows
it's not the right thing to do but
always ends up just trying it anyway
ways we're actually going to try to
navigate through that exact same road
closure later in the drive to see if the
same outcome happens and as we fast
forward to the next moment of Interest I
wanted to give a quick shout out to my
patreon supporters cuz I saved up every
dollar you guys have sent for months and
months and used it to buy a proper
editing computer which makes making
videos like this a lot easier cuz I
really was maxing out my previous
computer making these videos so thank
you for directly supporting the channel
and always know that every dollar I get
from patreon directly goes into
improving quality on the channel the
driver in front of us is a little bit
indecisive about his right turn up here
and you can see he slows down and then
speeds up and ends up making the ride at
a later time but full self-driving is
able to remain extremely smooth through
all of this it doesn't even slow down as
he's making the next right version 12
seems to be able to anticipate what
people are going to do really really
well and even when they do something
unexpected it's still still remain
smooth another really good example of
that up here we're on a pretty narrow
road where only one car fits at a time
and you can see it give the rideway to
this car but only slows down a little
bit and just maintains speed as it moves
over and then continues right on going
also love how early it offsets for
pedestrians compared to version 11
giving them no doubt that we see them
and we're controlling for them and there
was one specific really incredible
pedestrian interaction that happens a
little bit later in the video kind of a
funky intersection here where we have to
make this right turn and then make the
immediate left on that street that you
can see there and it gets a little bit
tripped up by this incoming car but as
soon as it was clear that he was going
to stop it goes ahead and proceeds no
problem we are about to reach our
destination and this time it actually
does not pull over it just kind of stops
in the road and it was fine cuz there
was nobody behind us so I just went
ahead and put in a new navigation route
real quick but kind of curious I don't
know the reason why sometimes it hunts
for a spot to pull over and other times
it just kind of stops in the road and
although it's doing a really good job on
these streets with no Lane lines or
anything going to go ahead and fast
forward until we get some more
interesting scenarios cuz there's a lot
we got to see in this video coming up
here we have our first pretty tough
unprotected left turn and the speed
limit on this road is 40 but as you can
see by the model y passing in front of
us traffic is Flowing a little bit
faster than that it does have to create
creep really far out here even over the
crosswalk in order to have any
visibility of incoming traffic and after
the car passes that comes from the right
it creeps out a little bit more make
sure it's safe and then proceeds you can
see it crossing right over those Lan
lines there taking the human path
through that turn for sure now it did
get pretty lucky in that unprotected
turn because there wasn't a lot of
traffic but I think unprotected turns
have actually been improved quite a bit
this version seems to be much more
cautious at intersection like this that
are kind of blind because of traffic
parked on both sides there was no creep
wall displayed in the visualizations
there but it did an excellent job of
creeping out right to the Limit before
proceeding when it had a good view on
both sides intersections like this are
pretty dangerous and unfortunately
extremely common around here but again
you can see how it creeps very very
slowly and kind of does one final stop
at the very end here before proceeding
confidently this seem to be pretty
consistent and it's nice because this is
exactly how humans behave in
intersections like this we creep out to
just before the point where we're
starting to obstruct traffic and then
take a look and then proceed when it's
safe there's a bus in our lane and
instead of staying behind it it actually
moves over to get beside it which is
probably the same thing I would have
done but there's actually a car ahead of
the bus and an immediate merge for a
moment it almost felt like it was
slowing to let the car in in front of us
but when they were slow to proceed off
the the light it just went for it
probably the same thing I would have
done in that situation and again loving
the way it's ignoring the lane lines
here and Crossing them very early you
can see it's uh pretty patient for this
unprotected left turn here I think the
last version would have just went for it
right now but this version stays a
little bit more patient and lets the
next car pass it does seem like they've
dialed back the assertiveness of these
unprotected turns which is probably a
good thing I must say that the amount of
progress I'm seeing in areas like those
compared to just one version ago is
really incredible and if these are the
kind of improvements we can expect going
forward 2024 is going to be a wild year
for full self-driving coming up here is
one more example of its creeping
Behavior at this uncontrolled
intersection with no signs or anything
you can see it just goes right to the
point where traffic is approaching slows
down and then proceeds once it can
actually see and we have a right to turn
coming up and based on our previous
experiences you'd think it'd be going
for it right now there's a huge gap and
it can easily fit in there but it does
not I think it probably learned its
lesson from the last time it tried to do
that I'm just kidding that's not a real
thing but that is one of the side
effects of having it completely AI based
is that you never really know what it's
going to do in any situation it really
makes things pretty interesting there is
a cyc to our right in an oncoming car
approaching and it decides to shoot the
Gap even running over the center line a
little bit which was extremely
human-like and probably how everybody
would have treated that situation that
is an area where older versions
struggled quite a bit now we've seen
quite a few pretty humanlike moves out
of the beta so far but this next one
definitely tops it it's probably one of
the most human things I've ever seen it
do we have a right turn to make at this
St light ahead and traffic in front of
us begins slowing down and they actually
come to a full stop here and a car
approaches from the right hand side out
of that parking lot instead of pulling
up behind the car in front of us which
would have blocked this guy into the
parking lot it takes the polite approach
and lets this guy go he even waves
thanks before he goes this was an
absolutely incredible move I remember
not that long ago full self-driving
wouldn't even drive over these green
markings on the road because it was
scary of them look how far we have come
and when I posted that clip on X there
were a few people that said the car
should have just taken the ride of way
which would have mean blocking him in
there and usually I am on team just take
your ride of way and don't be polite but
in that scenario I don't think the car
did anything wrong at all and I think
that was the correct move now our
navigation point is right up here off to
the left and about 100 ft and it does
seem like it just wants to come to a
stop in the middle of the road here
instead of trying to pull over again not
really sure when it decides to pull over
versus when it just stops in the middle
of the street but interestingly after it
sees this car approach it decides to
start moving again that is something
I've noticed with version 12 in general
is that if there's another car in the
scene it seems to make it kind of behave
differently like when we were at that
construction zone and a car pulled up
behind it it made it move and that is
something that that's pretty consistent
version 12 seems to have a little bit of
a sense of urgency I guess you could
call it when there's other traffic
around uh does end up just coming to a
complete stop here and unfortunately
it's brought itself down a dead end road
so after choosing a new navigation route
you can see it has to do a uturn in this
little court at the end of the road here
now version 12 can actually do u-turns
but it cannot back up so let's see if
it's able to complete the turn in this
small space starting out strong swinging
the wheel to the right but doesn't quite
turn hard enough to the left in order to
complete the maneuver and ends up just
stopping here which does cause our
second non-critical disengagement of the
drive cuz it needed a little bit of
human help at least until it has the
ability to reverse on its own and I did
only back up a little tiny bit here to