As I remember, (this is from memory so don't take it to the bank), but you need enough internal auditors so that there is no internal auditors auditing their own department.
So, you can't have an internal auditor from the quality department performing an audit of the quality department, for example..
__________________
Be careful of what you wish for .....