8.1. Computer Organization and Architecture: A Pedagogical Aspect

This is a small lecture where we summarize our discussion in the last 3 lectures. So, in order to execute a program a computer needs to fetch its instructions and data from memory and write process data back into memory.

In this section, we're discussing the fundamental operation of computers, specifically how they execute programs. Every program is made up of instructions, which the computer must retrieve from memory. Additionally, any data that the program operates on—like numbers or text—must also be stored in memory. After processing this data, results often need to be written back into memory. This cycle of fetching, processing, and writing is crucial for a computer's operation.

Imagine a chef in a kitchen. The chef needs to read recipes (instructions) from a cookbook (memory), use ingredients (data) from the pantry also located in the kitchen (memory), prepare the dish (process), and then write down any modifications or new recipes onto paper (write back to memory). Just like the chef relies on the kitchen to function efficiently, a computer relies on memory to execute programs.

Improvement in operating speed of processor chips has outpaced improvements in memory access times. So, the rate the speed at which the processor can execute instructions it is much faster than improvements in memory access time than the speed at which memory can be accessed.

Here, we are addressing a key issue in computer architecture: the disparity between processor speed and memory access speed. Over time, processors have become significantly faster, which means they can process instructions much quicker than data can be retrieved from memory. If memory access is slow, it creates a bottleneck; the processor can’t run instructions any faster than it can retrieve the required data from memory.

Think of a waiter in a busy restaurant. If the waiter is very quick (the processor), but the kitchen (memory) is slow in preparing the dishes, the waiter will still have to wait for the food to be served before they can take the next order. The efficiency of the entire operation depends on the kitchen being able to keep up with the waiter's speed.

To fully exploit the capability of a model processor, the computer must have large and fast memory. All these programs therefore need to be in the memory.

This chunk discusses the necessity of having both sufficient quantity and speed of memory in a computer system. As modern applications and programs are growing larger and more complex, having enough memory to store them while simultaneously running several of them becomes essential. If the memory is not large enough, the computer may struggle to execute all the programs efficiently.

Consider a library. If the library has only a few shelves (memory), it cannot hold enough books (programs) for all the patrons (users). Even if the shelves are well organized and easily accessible (fast), if there isn’t enough space, many of the books won’t be available when needed.

Although developments in semiconductor technology have led to spectacular improvements in the speeds, faster memory chips also suffer from higher cost per bit.

In this part, we explore the economic aspect of memory technology. While advancements in technology have made memory faster, this speed comes at a cost—it is substantially more expensive. The text indicates a trade-off where higher performance is often linked to higher prices, influencing decisions on the type and amount of memory used in computers.

It's akin to choosing a high-speed train service versus regular trains. The high-speed service is much faster and, therefore, charges more for a ticket. If someone prefers to travel quickly, they need to pay more; otherwise, they settle for slower, cheaper alternatives.

Given different memory types we have various technologies by which memories can be developed. And here for example, SRAM, DRAM and magnetic disk has been shown...

This segment discusses the variety of memory technologies available, such as SRAM (Static RAM), DRAM (Dynamic RAM), and magnetic disks, each varying in terms of cost and speed. SRAM is fast but expensive, making it suitable for cache memory, while DRAM is slower but more affordable, making it suitable for primary memory. Magnetic disks are even slower and cheaper, primarily used for long-term data storage.

Imagine storing items in different types of containers. If you have precious jewels (SRAM), you’d want a small, secure, and fast-access vault. If you have clothes (DRAM), a larger wardrobe would suffice, but it won’t be as quick to access as the vault. For rarely used items, such as seasonal decorations (magnetic disks), a storage shed is cost-effective, even if it takes longer to retrieve items from there.

The solution to the above problem of controlling both miss rates and miss penalties at affordable costs lies in having a hierarchy of memories.

This portion introduces the idea of memory hierarchy, which combines different types of memory, organized by speed and cost. The hierarchy typically consists of a small, fast cache (SRAM) at the top, then larger but slower main memory (DRAM), followed by even larger and slower secondary storage (magnetic disks). This structure aims to optimize performance while balancing cost and efficiency.

Think of a multi-level parking structure. The first floor has the fastest access for cars (cache), but there’s limited space. The second and third floors hold more cars (main memory), but they're slower to access. If you need something, you’re always preferencing that it’s on the first floor. If not, you will have to go to a higher floor, which takes more time, just like retrieving data from slower memory levels.

--