Think 'polish ideas together'. The old sense was polishing bone and ivory; today it lives in 磋商 (to negotiate, deliberate) and 切磋 (to compare notes and improve through exchange).
Left-side stone radical 石. The original meaning was grinding hard materials like bone and ivory against stone, so 石 carries the 'polish, rub' idea behind 切磋.