5. Banach Spaces
Definitions and Elementary Properties
Definition. A normed linear space is a vector space N over R or C in which to every vector x there corresponds a real number denoted ||x|| called the norm of x, with the properties
It is easy to verify that N is a metric space with respect to d defined by d(x,y) = ||x - y||. A Banach space is a complete normed linear space.
Examples. Let p be a real number such 1 ≤ p < ∞. Denote by lp(n) the space of all n-tuples x = (x1, ... , xn) of scalars, with the norm defined by
||x||p = (∑i = 1, ... , n |xi|p)1/p
We could also take n = ∞, that is, lp = lp(∞) is the space of all sequences x = {x1, x2, ... , xn, ...} such that ∑i = 1, ... , ∞ < ∞, with the norm defined by
||x||p = (∑i = 1, ... , ∞ |xn|p)1/p
More generally, if X is a measurable space with measure m, we could consider the space of all measurable f such that |f(x)|p is integrable, with
||f||p = (∫X |f(x)|p dm(x))1/p
Definition. A Hilbert space is a complex Banach space whose norm arises from an inner product, that is, a complex function (x, y) of vectors such that
Clearly the above properties imply
(x, αy + βz) = α- (x, y) + β- (x, z)
Example. The space l2, with the inner product of x = {x1, x2, ... , xn, ...} and y = {y1, y2, ... , yn, ... } defined by
(x, y) = ∑i = 1, ... , ∞ xiyi-
The Schwarz Inequality. If x and y are any two vectors in a Hilbert space then |(x, y)| ≤ ||x|| ||y||.
Proof. when y = 0, the result is clear, for both sides vanish. When y ≠ 0, the inequality is equivalent to |(x, y/||y||)| ≤ ||x||. Thus we have to prove that if ||y|| = 1 then |(x, y)| ≤ ||x|| for all x. But
0 ≤ ||x - (x, y) y||2 = (x - (x, y) y, x - (x, y) y)
= (x, x) - (x, y) (x, y)- - (x, y) (x, y)- + (x, y) (x, y)- (y, y)
= ||x||2 - |(x, y)|2.
Remark.This inequality in fact is needed to establish that ||x + y|| ≤ ||x|| + ||y||.
Definition. if X and Y are normed linear spaces and T: X → Y is a linear transformation, we say that T is bounded if there is an M such that ||Tx|| ≤ M ||x|| for all x ∈ X. In that case
||T|| = inf {M: ||Tx|| ≤ M ||x||, x ∈ X}
is called the norm of T.
Proposition. The following conditions are equivalent:
Proof. (1) ⇒ (2): If T is continuous at 0, then for every ε > 0, there is a δ > 0 such that ||x|| < δ implies ||Tx|| < ε. But then for arbitrary x, ||Tx|| = ||x|| ||T(x/||x||)|| = δ-1 ||x|| ||T(δx/||x||)||. thus T is bounded with ||T|| ≤ εδ-1.
(2) ⇒ (3). we have ||T(x - y)|| ≤ ||T|| ||x - y|| from the definition. Thus Tx → Ty as x → y and T is continuous at any arbitrary point y.
(3) ⇒ (1) is obvious.
Linear Transformations, Dual Space, and Banach Algebras.
Let B (X, Y) be the set of bounded linear transformations on X into Y. We shall show that B (X, Y) is a normed linear space which is a Banach space if Y is a Banach space.
Let T1, T2 ∈ B (X, Y). Define T1 + T2 by
(T1 + T2)(x) = T1(x) + T2(x)
and aT by
(aT)(x) = aT(x)
for every x ∈ X. Then
||T1 + T2|| ≤ ||T1|| + ||T2||
and
||aT|| = |a| ||T||
Moreover, ||T|| = 0 implies T = 0, so B (X, Y) is a normed linear space.
Suppose now that Y is complete. Let {Tn} be a Cauchy sequence in B (X, Y). Then, for any x ∈ X,
||Tm x - Tn x|| ≤ ||Tm - Tn|| ||x||
so that {Tn x} is a Cauchy sequence in Y. Since Y is complete we may define
Tx = limn Tn x for x ∈ X.
It is obvious that T is linear. Since {Tn}, {||Tn||} is bounded, i.e., there there is an M such that ||Tn|| ≤ M for all n. For every x, ||Tn x|| ≤ M ||x||. So, ||Tx|| ≤ M ||x||. Hence T ∈ B (X, Y).
Let ε > 0. Choose n0 so that ||Tm - Tn|| < ε if m, n > n0. Then
||Tm x - Tn x|| < ε ||x|| for m, n > n0, x ∈ X.
Letting n tend to infinity, we get
||Tm x - Tx|| ≤ ε ||x|| for m > n0, x ∈ X.
This implies ||Tm - T|| ≤ ε for m > n0, so that {Tn} converges to T in B (X, Y).
In particular, if y is one-dimensional, we write X' instead of B (X, Y). If X is a normed vector space, the space X' of continuous linear functionals on X, with norm
||x'|| = sup {|x'(x)|: ||x|| = 1}
= inf {M: |x'(x)| ≤ M ||x||, x ∈X}
is called the dual of X. We then have the
Corollary. The dual of a normed linear space is a Banach space.
Definition. Let X be a Banach space with an additional operation of multiplication (x, y) |→ xy defined so that X is a ring. If
||xy|| ≤ ||x|| ||y||
then X is said to be a Banach algebra.
It is easy to see that for any Banach space X, B (X, X) is a Banach algebra if the multiplication operation is taken to be composition of operators.
Two Important Theorems
(A) The Hahn-Banach Theorem. Let M be a linear subspace of a normed linear space, and let f be a functional defined on M. Then f can be extended to a functional f0 defined on the whole space N, such that ||F0|| = ||f||.
Lemma. Let M be a linear subspace of a normed linear space N and let f be a functional defined on M. If x0 is a vector not in M, and if
M0 = M + [x0]
is the linear space spanned by M and x0, then f can be extended to a functional f0 such that ||f0|| = ||f||.
Proof. Assume first that N is a real normed space. Without loss of generality, we can take ||f|| = 1 (f can be replaced by f/||f||). Each y ∈ M0 can be uniquely be written y = x + αx0, x ∈ M. we can define a functional f0 on M0 by f0 (x + αx0) = f(x) + αr0 for any real number r0. We have now to choose r0so that |f0 (x + αx0)| ≤ ||x + αx0||, that is
- ||x + αx0|| ≤ f(x) + αr0 ≤ ||x + αx0||
or
- f(x) - ||x + αx0|| ≤ αr0 ≤ - f(x) + ||x + αx0||
which is equivalent to
- f(x/α) - ||x/α + x0 ≤ r0 ≤ - f(x/α) + ||x/α + x0||
(1)
Next, for any vectors x1, x2 ∈ M
f(x2) - f(x1) ≤ ||f|| ||x2 - x1|| = ||x2 - x1||
≤ ||x2 - x0|| + ||x1 - x0||
so
- f(x1) - ||x1 + x0|| ≤ - f(2) + ||x2 + x0||
(2)
Setting
a = sup {- f(x) - ||x + x0||: x ∈ M}
b = inf {-f(x) + ||x + x0||: x ∈ M}
Then a ≤ b by (2). Choosing r0 such that a ≤ r0 ≤ b, inequality (1) is satisfied, completing the proof.
Let now N be complex, and f be a complex valued functional on M with ||f|| = 1. Then f(x) = g(x) + ih(x) where g and h are real valued functionals on the real space M. Since ||f|| = 1, we have ||g|| ≤ 1. Furthermore, it is easy to see that h(x) = - g(ix) (since f(ix) = if(x)), so f(x) = g(x) - ig(ix). We can extend g to a real valued functional g0 on the real linear space M0 so that ||g0|| = ||g|| and define f0(x) = g0(x) - ig0(x). then f0 is an extension of f. It remains to prove that ||f0|| = 1, that is, if x ∈ M0 and ||x|| = 1, then |f0(x)| ≤ 1. If f0(x) is real, f0(x) = g0(x) and ||g0|| ≤ 1. If f0(x) is complex, write f0(x) = reiθ, r > 0. Then
|f0(x)| = r = e-iθ f0(x) = f0(e-iθ x)
and our conclusion follows from ||eiθ x|| = ||x|| = 1 and the fact that f0(e-iθ x) is real.
Proof of Hahn-Banach Theorem. The set of all extensions of f to functionals g with the same norm defined on subspaces which contain M is clearly a partially ordered set with respect to the following relation: g1 ≤ g2 means that the domain of g1 is contained in the domain of g2, and g2(x) = g1(x) for all x in the domain of g1. It is easy to see that the union of any chain of extensions is also an extension and is therefore an upper bound for the chain. Zorn's lemma now implies that there exists a maximal extension f0. The domain of f0 must be the entire space N, for otherwise it could be extended further by our lemma and would not be maximal.
Corollary. Let N be a normed linear space and N* its dual. Then, for x ∈ N
||x|| = sup {|f(x)|: f ∈ N*, ||f|| = 1}
Hence, for fixed x ∈ N the mapping f |→ f(x) is a bounded linear functional on N* of norm ||x||, that is, N is isometrically imbedded in N**, the dual of its dual.
Proof. By the Hahn-Banach theorem, we can always find an f ∈ N* of norm 1 such that f(x) = ||x||. On the other hand, |f(x)| ≤ ||x|| if ||f|| = 1.
(B) The Uniform Boundedness Theorem. Let B be a Banach space and N a normed linear space. If [Ti} is a non-empty set of continuous linear transformations of B into N with the property that {Ti(x)} is a bounded subset of N for each vector x in B, then {||Ti||} is a bounded set of numbers; that is, {Ti} is bounded as a subset of B (B, N).
Proof. The proof makes use of Baire's Category Theorem.
For each positive integer n, the set
Fn = {x ∈ B: ||Ti(x)|| ≤ n for all i}
is clearly a closed subset of B, and by our assumption we have
B = ∪i = 1, ... , ∞Fn
Since B is complete, Baire's Theorem shows that one of the Fn's, say Fn0 has non-empty interior, and thus contains a closed sphere S0 with center x0 and radius r0 > 0. Then ||Ti(S0)|| ≤ for all i. It is clear that the translate S0 - x0 = {y - x0: y ∈ S0} is the closed sphere with radius r0 centered at the origin, so (S0 - x0)/r0 is the closed unit sphere. Since x0 ∈ S0, evidently ||Ti (S0 - x0)|| ≤ 2n0. Thus ||Ti(x)|| ≤ 2n0/r0 for ||x|| ≤ 1 and ||Ti|| ≤ 2n0/r0 for every i, completing the proof.
Note. The theory of normed linear spaces was first developed by Stefan Banach in a 1931 monograph in Polish which was translated into French in the following year as Théorie des opérations linéaires. Banach also discovered the Contraction Mapping Theorem.
Link. Lawrence Baggett"s online textbook "Functional Analysis" found at http://spot.colorado.edu/~baggett/functional.html gives a comprehensive exposition of the subject.