The labels are used for poems as well. A nonfiction poem would be something like Paul Revere's Ride by Longfellow. A fictional one would be The Raven by Poe.
Would a book of poems be fiction or non-fiction ?( Are those labels just for stories ?? )