Introduction to the convolution - Video Lecture - Engineering

In this video, I'm going to
introduce you to the concept
of the convolution, one of the
first times a mathematician's
actually named something
similar to what
it's actually doing.
You're actually convoluting
the functions.
And in this video, I'm not
going to dive into the
intuition of the convolution,
because there's a lot of
different ways you
can look at it.
It has a lot of different
applications, and if you
become an engineer really of any
kind, you're going to see
the convolution in kind of a
discrete form and a continuous
form, and a bunch of
different ways.
But in this video I just want
to make you comfortable with
the idea of a convolution,
especially in the context of
taking Laplace transforms.
So the convolution theorem--
well, actually, before I even
go to the convolution theorem,
let me define what a
convolution is.
So let's say that I have
some function f of t.
So if I convolute f with g-- so
this means that I'm going
to take the convolution of f and
g, and this is going to be
a function of t.
And so far, nothing I've written
should make any sense
to you, because I haven't
defined what this means.
This is like those SAT problems
where they say, like,
you know, a triangle b means a
plus b over 3, while you're
standing on one leg or
something like that.
So I need to define this
in some similar way.
So let me undo this silliness
that I just wrote there.
And the definition of a
convolution, we're going to do
it over a-- well, there's
several definitions you'll
see, but the definition we're
going to use in this, context
there's actually one other
definition you'll see in the
continuous case, is the integral
from 0 to t of f of t
minus tau, times g of t-- let me
just write it-- sorry, it's
times g of tau d tau.
Now, this might seem like a very
bizarro thing to do, and
you're like, Sal, how
do I even compute
one of these things?
And to kind of give you that
comfort, let's actually
compute a convolution.
Actually, it was hard to find
some functions that are very
easy to analytically compute,
and you're going to find that
we're going to go into a lot of
trig identities to actually
compute this.
But if I say that f of t, if I
define f of t to be equal to
the sine of t, and I define
cosine of t-- let me do it in
orange-- or I define g of t to
be equal to the cosine of t.
Now let's convolute
the two functions.
So the convolution of f with g,
and this is going to be a
function of t, it equals this.
I'm just going to show you how
to apply this integral.
So it equals the integral--
I'll do it in purple-- the
integral from 0 to t of
f of t minus tau.
This is my f of t.
So it's is going to be sine of
t minus tau times g of tau.
Well, this is my g of t, so
g of tau is cosine of tau,
cosine of tau d tau.
So that's the integral, and
now to evaluate it, we're
going to have to break out
some trigonometry.
So let's do that.
This almost is just a very
good trigonometry and
integration review.
So let's evaluate this.
But I wanted to evaluate this
in this video because I want
to show you that this isn't some
abstract thing, that you
can actually evaluate
these functions.
So the first thing I want to
do-- I mean, I don't know what
the antiderivative of this is.
It's tempting, you see a sine
and a cosine, maybe they're
the derivatives of each
other, but this is the
sine of t minus tau.
So let me rewrite that sine of
t minus tau, and we'll just
use the trig identity, that
the sine of t minus tau is
just equal to the sine of t
times the cosine of tau minus
the sine of tau times
the cosine of t.
And actually, I just made a
video where I go through all
of these trig identities really
just to review them for
myself and actually to make a
video in better quality on
them as well.
So if we make this subsitution,
this you'll find
on the inside cover of any
trigonometry or calculus book,
you get the convolution of f and
g is equal to-- I'll just
write that f-star g; I'll just
write it with that-- is equal
to the integral from 0 to t of,
instead of sine of t minus
tau, I'm going to write this
thing right there.
So I'm going to write the sine
of t times the cosine of tau
minus the sine of tau times the
cosine of t, and then all
of that's times the
cosine of tau.
I have to be careful with my
taus and t's, and let's see, t
and tau, tau and t.
Everything's working so far.
So let's see, so
then that's dt.
Oh, sorry, d tau.
Let me be very careful here.
Now let's distribute this
cosine of tau out,
and what do we get?
We get this is equal to-- so f
convoluted with g, I guess we
call it f-star g, is equal to
the integral from 0 to t of
sine of t times cosine of
tau times cosine of tau.
I'm just distributing
this cosine of tau.
So it's cosine squared of tau,
and then minus-- let's rewrite
the cosine of t first, and I'm
doing that because we're
integrating with
respect to tau.
So I'm just going to write my
cosine of t first. So cosine
of t times sine of tau times
the cosine of tau d tau.
And now, since we're taking
the integral of really two
things subtracting from each
other, let's just turn this
into two separate integrals.
So this is equal to the integral
from 0 to t, of sine
of t, times the cosine squared
of tau d tau minus the
integral from 0 to t of cosine
of t times sine of tau cosine
of tau d tau.
Now, what can we do?
Well, to simplify it more,
remember, we're integrating
with respect to-- let
me be careful here.
We're integrating with
respect to tau.
I wrote a t there.
We're integrating with
respect to tau.
So all of these, this
cosine of t right
here, that's a constant.
The sine of t is a constant.
For all I know, t could
be equal to 5.
It doesn't matter that one
of the boundaries of our
integration is also a t.
That t would be a 5,
in which case these
are all just constants.
We're integrating only with
respect to the tau, so if
cosine of 5, that's a constant,
we can take it out
of the integral.
So this is equal to sine of t
times the integral from 0 to t
of cosine squared of tau d tau
and then minus cosine of t--
that's just a constant; I'm
bringing it out-- times the
integral from 0 to t of sine
of tau cosine of tau d tau.
Now, this antiderivative is
pretty straightforward.
You could do u substitution.
Let me do it here, instead
of doing it in our heads.
This is a complicated
problem, so we don't
want to skip steps.
If we said u is equal to sine of
tau, then du d tau is equal
to the cosine of tau, just
the derivative of sine.
Or we could write that
du is equal to the
cosine of tau d tau.
We'll undo the substitution
before we evaluate the
endpoints here.
But this was a little bit
more of a conundrum.
I don't know how to take the
antiderivative of cosine
squared of tau.
It's not obvious what that is.
So to do this, we're going
to break out some more
trigonometric identities.
And in a video I just recorded,
it might not be the
last video in the playlist, I
showed that the cosine squared
of tau-- I'm just using tau as
an example-- is equal to 1/2
times 1 plus the cosine
of 2 tau.
And once again, this is just a
trig identity that you'll find
really in the inside cover of
probably your calculus book.
So we can make this substitution
here, make this
substitution right there, and
then let's see what our
integrals become.
So the first one over here,
let me just write it here.
We get sine of t times the
integral from 0 to t of this
thing here.
Let me just take the 1/2 out,
to keep things simple.
So I'll put the 1/2 out here.
That's this 1/2.
So 1 plus cosine of 2 tau and
all of that is d tau.
That's this integral
right there.
And then we have this integral
right here, minus cosine of t
times the integral from--
let me be very clear.
This is tau is equal to 0
to tau is equal to t.
And then this thing right
here, I did some u
subsitution.
If u is equal to sine of
t, then this becomes u.
And we showed that du is equal
to cosine-- sorry, u is equal
to sine of tau.
And then we showed that du is
equal to cosine tau d tau, so
this thing right here
is equal to du.
So it's u du, and let's see if
we can do anything useful now.
So this integral right here, the
antiderivative of this is
pretty straightforward, so
what are we going to get?
Let me write this
outside part.
So we have 1/2 times
the sine of t.
And now let me take the
antiderivative of this.
This is going to be tau plus
the antiderivative of this.
It's going to be 1/2
sine of 2 tau.
I mean, we could have done
the u substitution.
we could have said u is equal to
2 tau and all of that, but
I think you could do that from
recognition, and if you don't
believe me, you just have to
take the derivative of this.
1/2 sine of 2 tau is the
derivative of this.
You multiply, you take the
derivative of the inside, so
that's 2, so the 2 and the 1/2
cancel out, and the derivative
of the outside, so
cosine of 2 tau.
And you're going to evaluate
that from 0 to t.
And then we have minus
cosine of t.
When we take the antiderivative
of this-- let
me do this on the side.
So the integral of u du,
that's trivially easy.
That's 1/2 u squared.
Now, that's 1/2 u squared, but
what was u to begin with?
It was sine of tau.
So the antiderivative of this
thing right here is 1/2 u
squared, but u is sine of tau.
So it's going to be 1/2u, which
is sine of tau squared.
And we're going to evaluate
that from 0 to t.
And we didn't even have to do
all this u substitution.
The way I often do it in my
head, I see the sine of tau,
cosine of tau.
if I have a function and I have
its derivative, I can
treat that function just like
as if I had an x there, so
it'd be sine squared of tau over
2, which is exactly what
we have there.
So it looks like we're
in the home stretch.
We're taking the convolution of
sine of t with cosine of t.
And so we get 1/2 sine of t.
Now, if I evaluate this thing
at t, what do I get?
I get t plus 1/2 sine
of 2t, that's when I
evaluated it at t.
And then from that I need to
subtract it evaluated at 0, so
minus 0 minus 1/2 sine of
2 times 0, which is
just sine of 0.
So this part right here, this
whole thing right there, what
does that simplify to?
Well this is 0, sine of 0
is 0, so this is all 0.
So this first integral right
there simplifies to 1/2 sine
of t times t plus
1/2 sine of 2t.
All right, now what does this
one simplify to over here?
Well, this one over here, you
have minus cosine of t.
And we're going to evaluate this
whole thing at t, so you
get 1/2 sine squared of t
minus 1/2 the sine of 0
squared, which is just 0,
so that's just minus 0.
So far, everything that we have
written simplifies to--
let me multiply it all out.
So I have 1/2-- let me just pick
a good color-- 1/2t sine
of t-- I'm just multiplying
those out-- plus 1/4 sine of t
sine of 2t.
And then over here I have minus
1/2 sine squared t times
cosine of t.
I just took the minus cosine t
and multiplied it through here
and I got that.
Now, this is a valid answer,
but I suspect that we can
simplify this more, maybe using
some more trigonometric
identities.
And this guy right there
looks ripe to simplify.
And we know that the sine of
2t-- another trig identity
you'll find in the inside cover
of any of your books--
is 2 times the sine of t
times the cosine of t.
So if you substitute that there,
what does our whole
expression equal?
You get this first term.
Let me scroll down
a little bit.
You get 1/2t times the sine of
t plus 1/4 sine of t times
this thing in here, so times
2 sine of t cosine of t.
Just a trig identity, nothing
more than that.
And then finally I have this
minus 1/2 sine squared t
cosine of t.
No one ever said this was
going to be easy, but
hopefully it's instructive
on some level.
At least it shows you that you
didn't memorize your trig
identities for nothing.
So let me rewrite the whole
thing, or let me just
rewrite this part.
So this is equal to 1/4.
Now, I have-- well let
me see, 1/4 times 2.
1/4 times 2 is 1/2.
And then sine squared
of t, right?
This sine times this sine is
sine squared of t cosine of t.
And then this one over here is
minus 1/2 sine squared of t
cosine of t.
And luckily for us, or lucky
for us, these cancel out.
And, of course, we had this
guy out in the front.
We had this 1/2t sine
t out in front.
Now, this guy cancels with this
guy, and all we're left
with, through this whole hairy
problem, and this is pretty
satisfying, is 1/2t sine of t.
So we just showed you that the
convolution-- if I define--
let me write our result.
I feel like writing this
in stone because
this was so much work.
But if we write that f of t is
equal to sine of t, and g of t
is equal to cosine of t, I
just showed you that the
convolution of f with g, which
is a function of t, which is
defined as the integral from 0
to t of f of t minus tau times
g of tau d tau, which was equal
to-- and I'll switch
colors here-- which was equal to
the integral from 0 to t of
sine of t minus tau times g of
tau d tau, that all of this
mess, all of this convolution,
it all equals-- and this is
pretty satisfying-- it all
equals 1/2t sine of t.
And the whole reason why I went
through all of this mess
and kind of bringing out the
neurons that had the trig
identities memorized or having
to reproof them or whatever
else is to just show you that
this convolution, it is
convoluted and it seems a little
bit bizarre, but you
really can take the convolutions
of actual
functions and get an
actual answer.
So the convolution of sine
of t with cosine of t is
1/2t sine of t.
So, hopefully, you have a little
of intuition of-- well,
not intuition, but you at least
have a little bit of
hands-on understanding of how
the convolution can be
calculated.