9. Partial Differential Equations

In the study of mathematics, especially in the context of probability, statistics, and stochastic partial differential equations, the Expectation (or Mean) of a random variable plays a critical role. The concept serves as the foundational tool to measure the average or central tendency of a random variable's outcomes. In applied mathematics and physics, particularly when modeling uncertain systems through differential equations, expectation helps in analyzing average behaviors, predicting trends, and simplifying complex systems into manageable forms. In this section, we delve deep into the concept of Expectation, exploring its definitions, properties, computations for discrete and continuous random variables, and its application in solving real-world engineering problems.

Expectation, commonly referred to as the mean, is a crucial concept in mathematics and statistics. It provides a way to summarize the central value of a random variable. In practical terms, this means that when we conduct an experiment multiple times, the expectation gives us an idea of the average result we can expect in the long run. In contexts such as economics or physics, where uncertainty is common, the expectation helps in making predictions and decisions, often simplifying complex problems.

Imagine you are trying to predict the average score of students in a class based on previous exams. Each student's score can be seen as a random variable. By calculating the expectation of these scores, you can forecast what the average score might be in future tests, helping teachers make better lesson plans.

The expectation or mean of a random variable is the long-run average value of repetitions of the experiment it represents. Mathematically, it is defined as the weighted average of all possible values that a random variable can take, where the weights are the respective probabilities.

The expectation provides a mathematical way to quantify the average outcome of a random variable. It essentially takes into account all possible outcomes of an experiment and their likelihood of occurring. By multiplying each outcome by its probability and summing these products, we arrive at the expectation. This measurement is particularly useful in understanding how random variables behave over time.

Consider flipping a fair coin. The possible outcomes are heads or tails, each occurring with a probability of 0.5. If '1' represents heads and '0' represents tails, the expectation is calculated as: E(X) = (1 * 0.5) + (0 * 0.5) = 0.5, which indicates that if we flip the coin many times, the average result would be 0.5.

Let 𝑋 be a discrete random variable taking values 𝑥1, 𝑥2,...,𝑥𝑛 with corresponding probabilities P(𝑋 = 𝑥𝑖) = 𝑝𝑖, where ∑𝑛𝑖=1𝑝𝑖 = 1.

📌 Formula:

𝐸(𝑋) = ∑𝑥𝑖 ⋅𝑝𝑖

✅ Example: Let 𝑋 be the outcome of a fair 6-sided die. Then:

𝐸(𝑋) = (1/6) * (1 + 2 + 3 + 4 + 5 + 6) = 3.5

So, the expected value of a die roll is 3.5.

When dealing with discrete random variables, we can clearly identify the different values that the variable can assume along with their respective probabilities. The calculation of expectation in this case involves summing the products of each value and its associated probability. For example, when rolling a die, you can find the average (or expected) value of the roll by calculating the average of all possible outcomes weighted by their equal probabilities.

Think about a spinner divided into equal sections numbered 1 through 6. If you spin it a large number of times, you can use the expectation formula to determine that on average, the spinner will land on a number like 3.5 – indicating that over many spins, you would expect numbers lower and higher than 3.5 equally, balancing the results.

Let 𝑋 be a continuous random variable with probability density function (pdf) 𝑓(𝑥).

📌 Formula:

𝐸(𝑋) = ∫𝑥 ⋅𝑓(𝑥) 𝑑𝑥

✅ Example: Let 𝑋 ∼ 𝑈(0,1) (Uniform distribution from 0 to 1), so 𝑓(𝑥)= 1 for 𝑥 ∈ [0,1]

𝐸(𝑋) = ∫(0 to 1) x ⋅ 1 dx = [x²/2]0 to 1 = 0.5

So, the expected value is 0.5.

For continuous random variables, expectation is calculated differently using integration instead of summation. You need the probability density function (pdf) which describes how probabilities are distributed over different values. By integrating the product of the variable and its pdf across its entire range, you can find the expectation value. This gives you a single average that represents the central tendency of the variable.

Consider a scenario where you are measuring the time it takes for cars to pass through a toll booth. The time can vary continuously based on factors like weather and traffic. By using the pdf of this time variable, you can determine the expected time a car would take on average to pass through the toll, helping the toll authority manage traffic efficiently.

1. Linearity:

𝐸(𝑎𝑋+𝑏𝑌) = 𝑎𝐸(𝑋) +𝑏𝐸(𝑌)

for constants 𝑎,𝑏, and random variables 𝑋,𝑌.

2. Expectation of a Constant:

𝐸(𝑐) = 𝑐

3. Multiplicative Property (Independent Variables):

𝐸(𝑋𝑌) = 𝐸(𝑋)𝐸(𝑌) if 𝑋 and 𝑌 are independent.

4. Expectation of Function of Random Variable:

𝐸[𝑔(𝑋)] = ∑𝑔(𝑥𝑖)𝑝𝑖 (discrete), 𝐸[𝑔(𝑋)] = ∫𝑔(𝑥)𝑓(𝑥)𝑑𝑥 (continuous).

The properties of expectation help simplify computations involving random variables. The linearity property indicates that you can break down complex expectations into simpler parts. The expectation of a constant is straightforward, showcasing that a constant remains unchanged regardless of the randomness involved. Understanding how expectations interact under certain conditions—like independence—can significantly streamline analysis.

If you are working on financial projections, knowing how to use the linearity property can be advantageous. For instance, if you're forecasting income from two independent streams (e.g., salary and investments), you can calculate the expected total income by simply summing the expectations of each source without dealing with their variances or complex interactions.

Although this topic focuses on expectation, it's helpful to understand Variance, which measures the spread around the mean.

Var(𝑋) = 𝐸[(𝑋−𝐸(𝑋))²] = 𝐸(𝑋²)−[𝐸(𝑋)]².

While expectation gives us the average, variance tells us how much the values tend to spread out from that average. It's calculated as the expected value of the squared differences between each value and the mean. Understanding variance is essential as it complements the expectation by highlighting whether the data is tightly clustered around the mean or widely dispersed.

Imagine two schools with students' test scores. Both schools may have the same average score (expectation), but one school may have scores that are all very close to that average, while the other has a wide variety of scores. Variance helps to measure that difference in spread, indicating which school's students performed consistently versus inconsistently relative to their average score.

In Partial Differential Equations, particularly in stochastic PDEs, the concept of expectation appears in: • Heat equation under uncertainty: The solution might be a random field, and we take the expected temperature at a point. • Finance models (Black-Scholes): In pricing options, the expected payoff under risk-neutral probability is crucial. • Diffusion equations with probabilistic interpretations.

✅ Example: Heat Equation with Random Initial Condition If 𝑢(𝑥,𝑡,𝜔) is the temperature distribution (depending on a random event 𝜔), then the expected solution is: 𝑢‾(𝑥,𝑡) = 𝐸[𝑢(𝑥,𝑡,𝜔)] Solving for 𝑢‾(𝑥,𝑡) can sometimes lead to a deterministic PDE that is easier to analyze.

In the realm of partial differential equations (PDEs), the concepts of randomness and uncertainty are common, particularly in fields such as finance and physics. Expectation is used to find average solutions when dealing with such uncertainties. For instance, in a heat equation affected by random conditions, taking the expectation helps derive a simpler deterministic equation that still captures essential behaviors of the system.

Think about forecasting the weather where temperature predictions can vary due to multiple unpredictable factors like humidity or wind speed. If you were to model the temperature distribution across a region, expectation helps by providing an average forecast based on numerous possibilities instead of a precise but uncertain prediction. By working with expected values, meteorologists can give more reliable and manageable weather forecasts.

• Expectation (Mean) represents the average value a random variable takes. • For discrete variables: 𝐸(𝑋) = ∑𝑥𝑖𝑝𝑖. • For continuous variables: 𝐸(𝑋) = ∫𝑥𝑓(𝑥)𝑑𝑥. • Linearity and independence simplify complex computations. • In PDEs, especially in stochastic settings, expected values simplify analysis and provide deterministic insight into random systems.

In conclusion, the concept of expectation is vital for understanding the behavior of random variables in various contexts, from statistics to real-world applications in mathematics. By distinguishing between discrete and continuous variables, applying properties such as linearity, and integrating these concepts into stochastic PDEs, students can grasp how to measure and manipulate random phenomena effectively.

Expectation serves as a bridge between theoretical mathematics and practical applications, much like how a compass guides a traveler. Just as a compass can help someone navigate unfamiliar terrain by providing direction, understanding expectation helps individuals navigate uncertainty in data and predictions across fields like finance, science, and engineering.

--