The contact card can be dragged with a mouse or touch. Double-click it, press Escape, or press R to return it to its starting position.