4 Ways to Remove Wine Labels for Collecting - wikiHow Use the edge of a utility knife to lift the label off of the bottle. Slide the edge of a utility knife or razor blade underneath one corner of the label. Once you do this, slowly and gently peel the label off of the glass. Use the knife to cut through any stubborn patches of adhesive. [8]