You need to be aware that both of you come at relating from very different perspectives. Virgo always likes to be of service and ensures that all the fine practical details are working well, whilst Libra prioritizes the aesthetic and balance in the relationship. That can mean swinging from delightful harmony to rocking the boat madly, if there is not enough connection between you. Libra lives in the ideal world and Virgo lives in the perfected real world, so that makes it hard at times to meet. Virgo may be too busy to ensure that the connection is maintained and Libra may not be able to find Virgo because of their self effacement.