If you uninstalled everything and removed the folders, I don't see how the old ones would still be there. ??? Anyway, Do you have one of the following operating systems and are using the correct files for Apache, MySQL, and PHP ?
Windows XP, Windows Vista, Windows 7
Windows Essentials (AMD64/Intel EMm64T)
Windows Essentials (x86)
5.2.x zip Windows Binaries
Win32 Binary without crypto (no mod_ssl) 2.2.11-win3-x86-no ssl.msi
Mac OS X 10.5 (Leopard)
Mac OS X 10.5 (x86_64)
Mac OS X 10.5 (x86)
PHP 5 - built in
Apache 2.2 - built in
Ubuntu 8.10 (Linux)
also Fedora, Debian, openSUSE, Gentoo
MySQL - non RPM
Linux (AMD64/Intel EM64T)
Unix Source: httpd-2.2.11.tar.gz
And if you're trying to install PHP 5.3 you're using the correct one as described in the books errata ? http://www.sitepoint.com/books/phpmysql4/errata.php
p.12 Installing PHP
Although this book provides download and installation instructions for PHP 5.2, the newly-released (at the time of this writing) PHP 5.3 includes some new download options that aren’t covered in the book.
There are four different versions of PHP 5.3. for Windows: VC6 Non Thread Safe, VC6 Thread Safe, VC9 Non Thread Safe, and VC9 Thread Safe. Talk about confusing!
First of all, you definitely want a Thread Safe version of PHP. The Non Thread Safe versions are not suitable for use as a plugin for Apache.
Secondly, assuming you will install (or have already installed) a version of the Apache HTTP Server from httpd.apache.org (see page 13), you will need the VC6 version of PHP.
In short, to follow the instructions in this book, you need the VC6 Thread Safe version of PHP 5.3 for Windows.