Don't be so conflict-averse — just say it directly if there's a problem.
Tips
usage
怕事 describes someone who avoids trouble or confrontation, often out of timidity rather than wisdom. It carries a mildly negative connotation. Compare with 谨慎 (cautious), which is more positive.
