The vast majority of the time, I would also send someone to the most official build there is (such as those at httpd.apache.org), but I think this is an exception. I'm told that PHP is compiled with VC11 and Apache (from httpd.apache.org) is compiled with VC6, and that those can cause compatibility problems.
Also, in the PHP download, there are actually several Apache .dlls to choose from. There's a php5apache2_2.dll and a php5apache2_4.dll. You should choose the one appropriate for your version of Apache, which, if you downloaded the latest, will be 2_4.
If that doesn't help solve your problem, keyboardistdenny, then -- as several others have requested -- you need to tell us exactly what versions of Apache and PHP you downloaded, and where you got them from. Then show us the Apache configuration you've tried.