Step 1:

# rpm -e gpfs.msg.en_US gpfs.docs gpfs.gpl

Step 2:

# rpm -e gpfs.base
error: Failed dependencies:
gpfs.base is needed by (installed) gpfs.gplbin-2.6.32-279.el6.x86_64-3.4.0-12.x86_64

Step 3: Remove the specific gplbin

# rpm -e gpfs.gplbin-2.6.32-279.el6.x86_64-3.4.0-12.x86_64

Step 4:

# rpm -e gpfs.base

References:

1. Install and configure General Parallel File System (GPFS) on xSeries