6. Partial Differential Equations

In engineering and applied sciences, the concept of random variables plays a critical role in understanding uncertainty in physical systems, experimental outcomes, and probabilistic models.

This chunk introduces the concept of random variables, highlighting their importance in fields such as engineering and applied sciences. Random variables help in modeling uncertainty, which is a common aspect in physical systems and experimental results. Understanding how these variables operate is crucial for engineers as they often deal with unpredictable outcomes.

Imagine you are an engineer working on a new design for a bridge. You need to estimate how much weight the bridge can hold. However, due to factors like unexpected material fatigue, weather conditions, and user variability, there is uncertainty. Using random variables allows you to model this uncertainty and predict possible scenarios, helping you to design a safer bridge.

A Random Variable (RV) is a numerical outcome of a random experiment. It is a function that assigns a real number to each outcome in a sample space. Random variables are classified as: Discrete Random Variables and Continuous Random Variables.

A random variable is defined as a numerical outcome that comes from conducting a random experiment. For example, if you roll a die, the outcome is a random variable that can take values from 1 to 6. Random variables are categorized into two types: discrete and continuous. Discrete random variables take on countable values, while continuous random variables can take on any value within an interval.

Think of a game of Monopoly. The number of spaces you move after rolling the dice represents a discrete random variable; you can only land on whole number spaces. In contrast, if you consider how much money you might make in a year from investments, that could be a continuous random variable, as the amount can vary infinitely within a range.

A discrete random variable can take countable number of distinct values. Examples: Tossing a coin, rolling a die, number of defective items in a batch, etc. The Probability Mass Function (PMF) defines the probability of each of these values.

This chunk explains what discrete random variables are and provides examples. The PMF is a function that gives the probability of each possible value of a discrete random variable, ensuring that the total probabilities across all outcomes sum to 1. For instance, in a fair die, the probability of each side (1 through 6) appearing is 1/6.

Imagine you're at a carnival playing a game where you toss rings onto bottles. The number of rings you successfully toss onto the bottles can be counted (0, 1, or more). This situation is modeled with discrete random variables since you can only toss a whole number of rings, and the PMF would give the probabilities of landing on each number of bottles.

The PMF of a discrete random variable X is defined as: 𝑃(𝑋 = 𝑥 ) = 𝑝 where ∑𝑝 = 1 and 0 ≤ 𝑝 ≤ 1. Example: If X is the number on a fair six-sided die: 𝑃(𝑋 = 𝑥) = 1/6, 𝑥 = 1,2,3,4,5,6.

Here, we dive deeper into the PMF. It defines how to calculate the probability of each outcome of a discrete random variable. The sum of probabilities across all potential outcomes must equal 1, reflecting that one of these outcomes must happen. For example, when rolling a fair die, the probability for each face is equal and sums up to 1.

Envision a box of colored marbles, where there are 6 marbles of different colors. If you randomly select one marble, the PMF helps you understand the probabilities associated with picking each color. Each color has a 1/6 chance of being the chosen marble, just like each face of the die has a probability of 1/6.

The CDF of a discrete random variable X is: 𝐹(𝑥) = 𝑃(𝑋 ≤ 𝑥) = ∑𝑃(𝑋 = 𝑥 ) for all𝑖 where 𝑥 ≤ 𝑥.

The CDF provides a way to understand the probability that a discrete random variable is less than or equal to a particular value. It accumulates the probabilities from the PMF up to that value, giving a complete view of the distribution.

Suppose you are counting how many heads appear when flipping a coin multiple times. The CDF would let you know the probability of getting a certain number of heads or fewer, giving you a broader understanding of outcomes. For instance, if you want to know the probability of getting 2 heads from 3 flips, you would sum the probabilities of getting 0, 1, or 2 heads.

Expectation (Mean): 𝐸(𝑋) = ∑𝑥 𝑃(𝑋 = 𝑥 ). Variance: Var(𝑋) = 𝐸[(𝑋− 𝜇)2] = ∑(𝑥 − 𝜇)2𝑃(𝑋 = 𝑥 ).

Expectation, or the mean, gives the average value of a random variable, calculated as a sum of each outcome multiplied by its probability. Variance measures the spread of the random variable's possible values; it tells us how much the values deviate from the mean. Together, these two statistics are important for understanding the distribution of a random variable.

Consider a student's test scores over a semester. The average score (expectation) would tell you how well they're performing overall, while the variance would indicate how consistent their scores are. High variance means the scores are very spread out (some high, some low), while low variance suggests more consistent performance.

A continuous random variable takes values in an interval of real numbers (uncountably infinite). Examples: Temperature, pressure, time, voltage, etc.

Continuous random variables differ from discrete ones in that they can assume a continuous range of values. This means they can take on any real number within a specified interval. For instance, when measuring height, a person could be 5.5 feet, 5.75 feet, and so on, rather than just whole inches.

Think about the length of a piece of string. If you were to measure it, you could have any possible length value within a continuum and not just whole numbers. This is what makes continuous random variables essential for modeling real-world phenomena that are smoothly varying.

The PDF of a continuous random variable X is a function f(x) such that: 𝑏 𝑃(𝑎 ≤ 𝑋 ≤ 𝑏) = ∫ 𝑓(𝑥)𝑑𝑥 from a to b. Properties: • 𝑓(𝑥) ≥ 0 • ∫ 𝑓(𝑥)𝑑𝑥 = 1 from -∞ to ∞.

The PDF represents the likelihood of a continuous random variable taking on a specific value. While the probability of a continuous variable being exactly one value is technically zero, the PDF provides probabilities over intervals via integration. Its properties ensure that the total area under the PDF graph equals 1, reflecting the certainty of some outcome occurring.

Imagine you're looking at the distribution of heights among adult men. While you can't pinpoint exactly how many men are exactly 180 cm tall, the PDF lets you estimate how likely a given height falls within certain ranges, such as between 175 cm and 185 cm. The area under this range on the PDF gives you that probability.

𝐹(𝑥) = 𝑃(𝑋 ≤ 𝑥) = ∫ 𝑓(𝑡)𝑑𝑡 from -∞ to x.

The CDF for continuous random variables accumulates the probabilities of all outcomes up to a specified value x, providing insight into the likelihood of outcomes within a range. It integrates the PDF from negative infinity to x, reflecting all probability mass up to that point.

If you are analyzing how long it takes commuters to reach work and you want to know the probability that commuting time is under 30 minutes, you would use the CDF to integrate the PDF up to 30 minutes, which gives the area under the curve representing those commuting times.

Expectation: 𝐸(𝑋) = ∫ 𝑥𝑓(𝑥)𝑑𝑥 from -∞ to ∞. Variance: Var(𝑋) = ∫ (𝑥 − 𝜇)2𝑓(𝑥)𝑑𝑥 from -∞ to ∞.

For continuous random variables, expectation (or mean) is calculated as the integral of x times the PDF across all values. Variance is determined by how far the variable deviates from the mean, calculated by integrating the squared difference from the mean times the PDF. These measures help summarize the behavior of the random variable.

Consider the daily high temperatures in a city over a month. The expectation gives you the average temperature, providing insight into what you might expect on a typical day. Variance tells you how much the temperatures fluctuate above and below that average, providing useful information for planning and preparation, like clothing choices.

Example 1 (Discrete): Let X represent the number of heads in two tosses of a fair coin. Possible values: 0, 1, 2. Example 2 (Continuous): Let X have PDF: f(x) = 2x, 0 ≤ x ≤ 1.

Here, we see practical applications of both discrete and continuous random variables. The first example illustrates a discrete scenario where outcomes are countable (the number of heads). The second example shows a continuous case with a PDF defining probabilities over a range of values. Understanding these examples reinforces the concepts covered earlier.

In a game of flipping a coin, if you flip twice, the outcomes of heads can only be 0, 1, or 2 – that's the discrete example. Now, consider a continuous example: if you were measuring water usage and the amount used could vary from 0 to 1 liter continuously, the PDF tells you about probabilities over intervals of water consumption.

Feature Discrete RV Continuous RV Values Taken Countable Uncountable Probability Function PMF: 𝑃(𝑋 = 𝑥) PDF: 𝑓(𝑥), 𝑃(𝑎 < 𝑋 < 𝑏) Sum/Integral ∑𝑃(𝑋 = 𝑥 )= 1 ∫𝑓(𝑥)𝑑𝑥 = 1.

This comparison highlights the fundamental differences between discrete and continuous random variables. While discrete random variables have countable outcomes and utilize PMF, continuous random variables can have uncountable values and rely on PDFs for probability calculation. Understanding these differences is essential as they guide the methods used in analyzing data.

Think of a library: the number of books (discrete) can be counted, just like the rolls of dice. However, the amount of time you spend reading those books varies continuously, like the height of students in a class, and that's measured continuously.

--