A report from EY says wealthy individuals are the next growth point, but this will prove a difficult nut to crack.