3.2.2. Hardware-Accelerated Training and Inference

Try these first

1. 1.

   What is the primary function of hardware accelerators in AI?

   Hint

   Think about what makes calculations faster in AI.

2. 2.

   What does inference refer to in AI?

   Hint

   Consider the final steps after training a model.

3. 3.

   What is the primary purpose of GPUs in AI?

   • To generate graphics
   • To assist in parallel processing
   • To connect different hardware

   Hint

   Think about their original purpose in graphics.

4. 4.

   True or False: Inference is only relevant after a model is trained.

   • True
   • False

   Hint

   Consider the steps involved in deploying a model.

5. 5.

   Evaluate the impact of hardware acceleration on the development timeline for a new AI system aimed at real-time facial recognition.

   Hint

   Consider the time savings in terms of training versus inference.

6. 6.

   Design an experiment to compare the training times of a model on a CPU versus a GPU, detailing the metrics you would use to measure performance.

   Hint

   What would you focus on to ensure results are conclusive?