Is hearing loss ear more susceptible to noise damage compared to normal ear?

Can we still drive freeway, walk the street, eat in noisy restaurant ? Or are we prone to noise damage in moderately loud environment/