A Problem Shared: How do you deal with a serial dater?

The 'A Problem Shared' panel

The only young man in his late 20s attending our church is causing problems, as he seems to be slowly dating each woman of around his age in the church – and breaking hearts along the way. I am concerned that if I step in and discipline him, he may leave the church, and I am really keen see more young adults in the church. What should I do?