Club cites travel concerns for withdrawing from Coastal Premier League