7.4.2. Memory Architecture and Data Movement

Try these first

1. 1.

   What is shared memory?

   Hint

   Think about how memory access works in a multi-core processor.

2. 2.

   What is distributed memory?

   Hint

   Consider systems where each CPU has its memory.

3. 3.

   What type of memory architecture allows all processors to access a common area?

   • Shared Memory
   • Distributed Memory
   • Virtual Memory

   Hint

   Think about scenarios with multi-core processors.

4. 4.

   True or False: Distributed memory systems can experience contention issues.

   • True
   • False

   Hint

   Remember how distributed systems work.

5. 5.

   Considering a high-performance AI application, how could you structure your architecture to optimize both access speed and communication overhead? Design both a shared memory and distributed memory model and explain the trade-offs.

   Hint

   Think about how latency and contention affect performance.

6. 6.

   Evaluate a scenario where using shared memory might result in bottlenecks. Discuss how you would redesign the system using distributed memory for better performance.

   Hint

   Consider heavy-load scenarios where too many access requests are made to the memory.