Imaging at a trillion frames per second | Ramesh Raskar
Articles Blog

Imaging at a trillion frames per second | Ramesh Raskar

October 20, 2019

Translator: Joseph Geni
Reviewer: Thu-Huong Ha Doc Edgerton inspired us
with awe and curiosity with this photo of a bullet
piercing through an apple, and exposure just a millionth of a second. But now, 50 years later,
we can go a million times faster and see the world
not at a million or a billion, but one trillion frames per second. I present to you
a new type of photography, femto-photography, a new imaging technique so fast that it can create slow motion
videos of light in motion. And with that, we can create cameras
that can look around corners, beyond line of sight, or see inside our body without an x-ray, and really challenge
what we mean by a camera. Now if I take a laser pointer
and turn it on and off in one trillionth of a second — which is several femtoseconds — I’ll create a packet of photons
barely a millimeter wide. And that packet of photons, that bullet, will travel at the speed of light, and again, a million times faster
than an ordinary bullet. Now, if you take that bullet
and take this packet of photons and fire into this bottle, how will those photons
shatter into this bottle? How does light look in slow motion? [Light in Slow Motion …
10 Billion x Slow] Now, the whole event — (Applause) Now remember, the whole event
is effectively taking place in less than a nanosecond — that’s how much time
it takes for light to travel. But I’m slowing down in this video
by a factor of 10 billion, so you can see the light in motion. (Laughter) But Coca-Cola did not
sponsor this research. (Laughter) Now, there’s a lot going on in this movie, so let me break this down
and show you what’s going on. So the pulse enters
the bottle, our bullet, with a packet of photons
that start traveling through and that start scattering inside. Some of the light leaks,
goes on the table, and you start seeing
these ripples of waves. Many of the photons
eventually reach the cap and then they explode
in various directions. As you can see, there’s a bubble of air and it’s bouncing around inside. Meanwhile, the ripples
are traveling on the table, and because of the reflections at the top, you see at the back of the bottle,
after several frames, the reflections are focused. Now, if you take an ordinary bullet and let it go the same distance
and slow down the video — again, by a factor of 10 billion — do you know how long you’ll have to sit
here to watch that movie? (Laughter) A day, a week? Actually, a whole year. It’ll be a very boring movie — (Laughter) of a slow, ordinary bullet in motion. And what about some
still-life photography? You can watch the ripples,
again, washing over the table, the tomato and the wall in the back. It’s like throwing a stone
in a pond of water. I thought: this is how
nature paints a photo, one femto frame at a time, but of course our eye sees
an integral composite. But if you look at this tomato
one more time, you will notice, as the light
washes over the tomato, it continues to glow. It doesn’t become dark. Why is that? Because the tomato is actually ripe, and the light is bouncing
around inside the tomato, and it comes out after several
trillionths of a second. So in the future, when this femto-camera
is in your camera phone, you might be able to go to a supermarket and check if the fruit is ripe
without actually touching it. (Laughter) So how did my team at MIT
create this camera? Now, as photographers, you know, if you take a short exposure photo,
you get very little light. But we’re going to go a billion times
faster than your shortest exposure, so you’re going to get hardly any light. So what we do is we send that bullet — that packet of photons —
millions of times, and record again and again
with very clever synchronization, and from the gigabytes of data, we computationally weave together to create those femto-videos I showed you. And we can take all that raw data
and treat it in very interesting ways. So, Superman can fly. Some other heroes can become invisible. But what about a new power
for a future superhero: To see around corners. The idea is that we could
shine some light on the door, it’s going to bounce, go inside the room, some of that is going to reflect
back on the door, and then back to the camera. And we could exploit
these multiple bounces of light. And it’s not science fiction.
We have actually built it. On the left, you see our femto-camera. There’s a mannequin hidden behind a wall, and we’re going to bounce
light off the door. So after our paper was published
in Nature Communications, it was highlighted by, and they created this animation. (Music) [A laser pulse is fired] (Music) Ramesh Raskar: We’re going to fire
those bullets of light, and they’re going to hit this wall, and because of the packet of the photons, they will scatter in all the directions, and some of them will reach
our hidden mannequin, which in turn will again
scatter that light, and again in turn, the door will reflect
some of that scattered light. And a tiny fraction of the photons
will actually come back to the camera, but most interestingly, they will all arrive
at a slightly different time slot. (Music) And because we have a camera
that can run so fast — our femto-camera —
it has some unique abilities. It has very good time resolution, and it can look at the world
at the speed of light. And this way, we know the distances,
of course to the door, but also to the hidden objects, but we don’t know which point
corresponds to which distance. (Music) By shining one laser,
we can record one raw photo, which, if you look on the screen,
doesn’t really make any sense. But then we will take
a lot of such pictures, dozens of such pictures,
put them together, and try to analyze
the multiple bounces of light, and from that, can we see
the hidden object? Can we see it in full 3D? So this is our reconstruction. (Music) (Applause) Now, we have some ways to go before we take this
outside the lab on the road, but in the future, we could create
cars that avoid collisions with what’s around the bend. Or we can look for survivors
in hazardous conditions by looking at light reflected
through open windows. Or we can build endoscopes that can see
deep inside the body around occluders, and also for cardioscopes. But of course,
because of tissue and blood, this is quite challenging, so this is really a call for scientists to start thinking about femto-photography as really a new imaging modality to solve the next generation
of health-imaging problems. Now, like Doc Edgerton,
a scientist himself, science became art — an art of ultra-fast photography. And I realized that all the gigabytes of data
that we’re collecting every time, are not just for scientific imaging. But we can also do a new form
of computational photography, with time-lapse and color coding. And we look at those ripples. Remember: The time between each of those ripples
is only a few trillionths of a second. But there’s also something
funny going on here. When you look at the ripples
under the cap, the ripples are moving away from us. The ripples should be moving towards us. What’s going on here? It turns out, because we’re recording
nearly at the speed of light, we have strange effects, and Einstein would have loved
to see this picture. (Laughter) The order at which events
take place in the world appears in the camera
sometimes in reversed order. So by applying the corresponding
space and time warp, we can correct for this distortion. So whether it’s for photography
around corners, or creating the next generation
of health imaging, or creating new visualizations, since our invention, we have open-sourced all the data
and details on our website, and our hope is that the DIY,
the creative and the research communities will show us that we should stop obsessing
about the megapixels in cameras — (Laughter) and start focusing
on the next dimension in imaging. It’s about time. Thank you. (Applause)

Only registered users can comment.

    You Have a rare disease Called "SnookapoolballinyourassholewhenhismomstittysmalleatenbyAllhisSisterisasexdoLLinSavanawith3BananaInherVagina".

  2. I haven't heard or saw anything like this till now. And they even open sourced all their research and data, then why people are not aware of it?

  3. In one of Machio's Books he wrote about tracking photons, or other particles and backtracking threw the interactions they've had to look backwards in time. Basically if one day we could figure the exact location of every particle at the point of the big bang, you can figure out when and where, and what happened with 100% accuracy. I taught it sounds to sci-fi, but for some reason i feel this is on path to that goal.

  4. It took YouTube 7 years to recommend me this??? This is one of the greatest thing a human can see in their whole lifetime!!!

  5. Surprised to see that this person was not even considered for Nobel prize in Physics . Even though Higgs and his friend won nobel prize for Higgs-field in 2013(I admit its one of the greatest discoveries too ). But what about being there in 2014 or the later years???

  6. Good.. Next Mailstone.. Avathar.. Move we talk about 3000years before.. Time and Travel… Tamil..
    People best of best in the world…but he is also tamila… Kallku.. Bankali….

    We will show them Our signs in the horizons and within themselves until it becomes clear to them that it is the truth. But is it not sufficient concerning your Lord that He is, over all things, a Witness?
    Allah is the Light of the heavens and the earth. The example of His light is like a niche within which is a lamp, the lamp is within glass, the glass as if it were a pearly [white] star lit from [the oil of] a blessed olive tree, neither of the east nor of the west, whose oil would almost glow even if untouched by fire. Light upon light. Allah guides to His light whom He wills. And Allah presents examples for the people, and Allah is Knowing of all things.


    God is light and therefore can see everywhere.

  8. Fantastic…. The first time, in humanity, that we can see the light running…
    If only Einstein could have seen that…
    Fantastic job from the MIT. Congratulations.
    From Brussels, with Love…

  9. индус блять рассказывает белым людям про фотографию ..Охуенно что я тоже индус !

  10. A good example of a failed technology?; 7 years later and still nothing;
    The reflected photons given off by the body of the person hidden around the corner,cannot all hit the camera lens back,i would think;too much scattering, it's camera-door-person-door-camera.

  11. What happens if you would build a Teleskope with the abbility to film with femtophothographie? You can see light expand, wouldn't that be groundbreaking for astronomie?

  12. Wow just amazing 😱👏 we just see the light in running wow this is really amazing excellent😭i cant imagine something like this can be possible…sorry my is not very good😝

  13. Lets be honest, If coca cola didn't invent those bottles this experiment would have been unable to perform. Thank the Lord almighty Jesus fucking Christ for coca cola.

  14. Wait a second, how can you even see the fastest object in motion when the object itself is responsible for seeing the event itself??

  15. So basicly this is how Li-Fi will somehow work? Just wow sometimes I think that I'm too stupid for this world look at all those inventions

  16. I came up with an advanced scientific explanation.

    The alien who was alive in the Roswell case

    According to the story, the eyes can see the other side of the blind spot of the door

    It seems to have had.

    The human race has gained a similar and common super technology.

  17. I think many people misunderstand what is being seen… this is a composite of a trillion different photon packets photographed in sequence…. it is not a single photon packet photographed a trillion times lol… that is mechanically impossible. This is why ambient light is observed is from preceding photon packets. a real time view of this would appear as a stream of steady light….it would be composed of a solid stream or beam of connected photon packets… know….the way we see light in real time. There is no technology or camera that exists that can literally produce a trillion frames per second….it would operate at the speed of light. NOT POSSIBLE.

  18. there is no such thing as the present in time, you can`t put a number like trillionth of second so if there is no present there are no past or future

  19. I have met this man in personnel. Very humble, down to earth personally. Ramesh has got number of unbelievable achievement in very short time. I am proud that, he is from my hometown. Congratulations 💐

  20. There's something frightening about seeing packets of light moving. It seems like one of those things that humans aren't supposed to be seeing.

  21. 2012: we have trillion fps camera, soon in your phone
    2019, Iphone: can't adjust the camera settings yet.. we chose you 4:3

  22. All this research, time and effort was all done for a good cause.
    It was to pull off his dad joke at the end.
    Look at that smile! =D

  23. 2080 год.

    – мам, купи эту помидорку.
    – сынок, ее расстреляли фотонами, возьми лучше грушу.

  24. полное вранье. и про рекламу кока колу тоже. в любом случае должно было быть рывки света.

  25. Someone pls explain me why this is called femto-photography and not pico-photography. (1pico=10^-12) An exaggeration perhaps or somethinh else? Great experiment !!!!!

  26. I was just thinking creating a new superhero with the power to see in fractions of fractions of a second with new senses like "experiencing" real time forces in the world, and he said 5:49

  27. Excellent video disclosing amazing new photographic means of taking equivalent to a trillion frames per second. Very interesting and capable of photographing a traveling laser light pulse .

  28. I used this video for presentation during my final year course in Lasers and optics some years ago and I got the highest mark!

  29. You gotta be fck joking me… You couldnt take that coca cola wrapper off? REALLY?????????????????????? You're doing an amazing experiment and this is how you record it??? For fkc sake… for fck sake…..

  30. Название на русском,но ни перевода,ни русских комментариев(((

Leave a Reply

Your email address will not be published. Required fields are marked *