31. Python Programs Using Data Handling and Visualization Libraries

In this chapter, students will learn how to write simple Python programs that perform basic data processing and visualization tasks. Using Python libraries like NumPy, Pandas, Matplotlib, and OpenCV, we can analyze data, create visualizations such as line and scatter plots, and even work with image files. These skills form the basis for understanding AI and machine learning pipelines, which rely heavily on data manipulation and visualization.

This introduction outlines what students will learn in this chapter about Python programming. They will focus on data processing and visualization—skills essential for working in fields such as Artificial Intelligence and Machine Learning. The chapter introduces various libraries—NumPy for numerical operations, Pandas for data manipulation, Matplotlib for plotting graphs, and OpenCV for image handling. Understanding these libraries is crucial for efficiently analyzing data and creating visual representations of that data.

Consider a chef preparing a new dish. They need to gather ingredients (data), know how to mix them (process the data), and then serve them in an appealing way (visualization). Just like a chef uses the right tools and techniques to create a delicious dish, you will learn to use Python libraries to handle and visualize data beautifully.

Program Objective: Write a Python program to add the corresponding elements of two lists.

Code:

list1 = [10, 20, 30, 40, 50]
list2 = [5, 15, 25, 35, 45]
# Adding elements
result = [a + b for a, b in zip(list1, list2)]
print("List 1:", list1)
print("List 2:", list2)
print("Sum of lists:", result)

Here, students learn how to perform element-wise addition on two lists. The zip function pairs up elements from both lists so that they can be added together in a single line using list comprehension. result holds the sum of the paired elements, which is then printed for clarity. This concept is fundamental in programming, demonstrating how to manipulate data structures like lists.

Imagine you have two shopping lists, one with the quantities you have (list1) and another with the additional items you want (list2). When you combine them item by item, you get a new list showing how much of each item you will have in total. That's similar to how we added the two lists in this program.

Program Objective: Calculate mean, median, and mode using NumPy and SciPy libraries.

Code:

import numpy as np
from scipy import stats
data = [10, 20, 20, 30, 40, 50, 50, 50, 60]
mean = np.mean(data)
median = np.median(data)
mode = stats.mode(data)
print("Data:", data)
print("Mean:", mean)
print("Median:", median)
print("Mode:", mode.mode[0])

In this part, students use NumPy and SciPy libraries to compute three important statistics: mean (average), median (middle value), and mode (most frequent value) of a dataset. Using np.mean(data), np.median(data), and stats.mode(data), they can effectively summarize and interpret datasets, which is crucial for data analysis.

Think of a classroom of students taking a test. The mean score gives an overall performance level, the median score indicates what the middle student scored, and the mode score identifies the score that most students received. Learning how to calculate these stats provides helpful insights into the class's performance just as we analyze data.

Program Objective: Display a line chart using Matplotlib.

Code:

import matplotlib.pyplot as plt
x = [2, 3, 4, 5, 6, 7, 8, 9]
y = [5, 6, 7, 8, 9, 9.5, 10, 10]
plt.plot(x, y, marker='o', linestyle='-', color='blue')
plt.title("Line Chart")
plt.xlabel("X-axis")
plt.ylabel("Y-axis")
plt.grid(True)
plt.show()

Students learn to visualize relationships between data points by creating a line chart. The x and y lists define the coordinates of the points on the graph. The plt.plot function creates the line chart, where input details such as color and markers enhance visual appeal. The plt.show() command then displays the chart to the user.

Consider tracking the temperature over a week. Each day's temperatures can be plotted on a graph. By connecting these points with a line, you can easily see trends, like whether the temperature is rising or falling. Creating charts like this helps you quickly gain insights from the data.

Program Objective: Create a scatter plot of given data points.

Code:

import matplotlib.pyplot as plt
x = [2, 9, 8, 5, 6]
y = [5, 10, 3, 7, 18]
plt.scatter(x, y, color='red')
plt.title("Scatter Plot")
plt.xlabel("X-axis")
plt.ylabel("Y-axis")
plt.grid(True)
plt.show()

This section introduces scatter plots, which are great for visualizing the relationship between two variables. Each pair of x and y values is represented by a point on the plot. The use of different colors and styles improves readability and helps distinguish between different datasets or categories.

Imagine plotting the heights and weights of a group of students on a chart to see if there's a correlation. Each student represents a point on the scatter plot, helping you visualize how weight and height vary together. This kind of visualization helps reveal patterns and relationships in data.

Program Objective: Read and display the first 10 rows of a CSV file using Pandas.

Code:

import pandas as pd
# Replace 'filename.csv' with the actual path of your CSV file
df = pd.read_csv("filename.csv")
print(df.head(10))

In this part, students learn how to read CSV files—commonly used for storing tabular data—using the Pandas library. The pd.read_csv() function imports the data into a DataFrame. The head(10) function then allows users to view the first ten rows, making it easier to understand the structure and content of the dataset.

Think of a CSV file as a digital spreadsheet. Just as you can open and view a spreadsheet on your computer, the code allows you to extract and display tabular data in Python. This helps you quickly assess data without needing to open another application.

Program Objective: Read a CSV file and display information such as column names, data types, and non-null values.

Code:

import pandas as pd
df = pd.read_csv("filename.csv")
print("Basic Information of the Dataset:\n")
print(df.info())

Here, students dive deeper into understanding datasets by using the info() method from Pandas. This method provides a summary of the DataFrame, including column names, data types, and the count of non-null values. This information is essential for preliminary data analysis, helping students assess the completeness and types of data they're working with.

When reviewing a new book in a library, you check the title, author, and publication date. Similarly, the info() method provides a quick snapshot of the dataset, giving you the essential information about the columns and types of data before deciding on your analysis approach.

Program Objective: Read and display an image using OpenCV.

Code:

import cv2
# Replace 'image.jpg' with the actual image filename
img = cv2.imread('image.jpg')
# Display the image
cv2.imshow('Displayed Image', img)
cv2.waitKey(0)
cv2.destroyAllWindows()

In this segment, students learn how to use OpenCV to read and display images. The cv2.imread() function loads an image from the specified path, and cv2.imshow() creates a window to present it. cv2.waitKey(0) is included to keep the image displayed until a key is pressed, while cv2.destroyAllWindows() closes the displayed window afterward.

Consider opening a photo on your computer. Just like you click on an image file to view it, this code allows your program to read and display an image file. It’s particularly useful in programming environments where you want to visualize images as part of your analysis or application.

Program Objective: Read an image and identify its dimensions (height, width, channels).

Code:

import cv2
img = cv2.imread('image.jpg')
print("Image shape (Height, Width, Channels):", img.shape)

This final part of the chapter focuses on extracting and displaying the shape of an image, which includes its dimensions and the number of color channels. The img.shape property returns a tuple indicating height, width, and the number of channels (for color images). Understanding image shapes helps in various image processing tasks.

Think of an image as a box of chocolates. Just like you might want to know the size of the box and how many pieces it contains, knowing the shape of an image lets you understand its size and complexity, which is crucial when performing processing tasks like resizing, filtering, or analyzing color data.

--