If your apache server tells you in error.log something like

server reached MaxClients setting, consider raising the MaxClients setting

and is slow like hell, consider means by all means do.
Even if it doesn't look like this is the problem.