When I Pay for the Course, Am I Also Paying for My Certification Exam Fee?

No. You are paying only the course fee. Certification exam fee is paid to Project Management Institute (PMI), the process for which is explained in the Exam and Certification section.