How to delete words from column name using Python

While analyzing large datasets, we get common repetitive words in multiple columns. The names become irrelevant to the analysis when comparing, therefore, we try to keep the uniqueness of the column name.

By Tookapic from Pexels

There are multiple ways to approach any problem, this is no different. One of the most common ways people go about this issue is replacing the column name discreetly one by one. Let’s say we have a dataset on mobile phones, and the dataset has the first column as Manufacture_name. We can easily replace that with Name or Company. However, if there are multiple columns with Manufacture in it, this is how to go about it.

  1. Get essential libraries
import pandas as pd #Loading packages

2. Import the dataset; Here we are assuming a CSV file

data = pd.read_csv('filepath\\filename')
#filename should also contain type of file like .csv or .txt
#For large files use
data = pd.read_csv('filepath\\filename', low_memory = False)

3. (Optional) Check the dataset and column names


4. Creating a list of custom words we want to remove

Instead of running the same program multiple times, to remove different words, we create a list of words which can we used to run only once. For example, our data set has two common words say Manufacture and Supplier with column names Manufacture_name, Manufacture_id, Manufacture_Location, Supplier_count, Supplier_Amount, and so on.

words = ['Manufacture_' , 'Supplier_'] #Python is case sensitive
#Each words needs to exactly like the column name

5. Creating a new list for modified column names

c = list()
c = data.columns.tolist()
for i in range(len(c)): #Loop every column
for word in words: #Loop for every word
c[i] = c[i].replace(word,'')

6. Modifying the existing column names with new names

data.columns = c

7. (Optional) Check the dataset again for updated column names


8. Export dataset for future use; Assuming CSV file


Using this code before analysis will help in finding the uniqueness in column names so all the important and relevant information is available and all the common and unimportant names are removed.



Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store