Mice are generally only attracted to things they can eat or use for a nest. They have excellent senses of smell and can seek out food even through barriers and can chew through almost anything to get at it. Foods that have a high scent and foods that are sweet are preferred by mice.
As for nesting material, mice like anything that is somewhat soft that can be dragged away easily to their nest, such as bits of cloth, shredded paper, or straw.