Not really a proven fact from what I can find. But, a Mayo Clinic report said the creases are due to loss of elastin, the protein present in the arteries, responsible for maintaining their flexibility. An inflexible earlobe is not a problem but an inflexible artery is.
Stop scratching your earlobe when somebody ask you a question? It is not earth shaking thing to worry about?